-- Logs begin at Thu 2021-10-28 07:56:21 UTC, end at Thu 2021-10-28 09:01:12 UTC. -- Oct 28 08:30:56.234623 dv-cinder-815660-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 08:30:56.244283 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 08:30:56 2021] *** Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: nodename: dv-cinder-815660-3-iscsi Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: machine: x86_64 Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: clock source: unix Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: pcre jit disabled Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: detected number of CPU cores: 4 Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: current working directory: / Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: detected binary path: /usr/bin/uwsgi-core Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: your processes number limit is 47680 Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: your memory page size is 4096 bytes Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: detected max file descriptor number: 2048 Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: lock engine: pthread robust mutexes Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: thunder lock: enabled Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 08:30:56.247417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 08:30:56.291749 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: Python main interpreter initialized at 0x5647456e39c0 Oct 28 08:30:56.291749 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: python threads support enabled Oct 28 08:30:56.291749 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: your server socket listen backlog is limited to 100 connections Oct 28 08:30:56.291749 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: your mercy for graceful operations on workers is 90 seconds Oct 28 08:30:56.292159 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 08:30:56.292159 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: *** Operational MODE: preforking *** Oct 28 08:30:56.292475 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: *** uWSGI is running in multiple interpreter mode *** Oct 28 08:30:56.292475 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: spawned uWSGI master process (pid: 107420) Oct 28 08:30:56.292695 dv-cinder-815660-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 08:30:56.294417 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: spawned uWSGI worker 1 (pid: 107421, cores: 1) Oct 28 08:30:56.294757 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: spawned uWSGI worker 2 (pid: 107422, cores: 1) Oct 28 08:30:56.294923 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 08:30:57.977837 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:30:57.977837 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: from cryptography.utils import int_from_bytes Oct 28 08:30:57.978489 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:30:57.978489 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: from cryptography.utils import int_from_bytes Oct 28 08:30:57.994284 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:30:57.994284 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: from cryptography.utils import int_from_bytes Oct 28 08:30:57.994841 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:30:57.994841 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: from cryptography.utils import int_from_bytes Oct 28 08:31:00.709370 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 08:31:00.710016 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 08:31:00.710098 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 08:31:00.710469 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 08:31:00.710563 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 08:31:00.710653 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 08:31:00.710753 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 08:31:00.710819 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 08:31:00.711012 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 08:31:00.711101 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.711274 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 08:31:00.711376 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.711668 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.711754 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.712001 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.712095 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.712328 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.712422 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.712638 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.712732 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.712962 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.713048 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.713276 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.713369 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.713601 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.713691 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.713962 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.714069 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.714297 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.714444 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.714614 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-3-iscsi {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.714713 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.714942 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.715043 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.715795 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.715887 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-3-iscsi {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.716137 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.716239 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.716452 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.716574 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.716767 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.716884 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.717090 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.717202 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.717401 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.717502 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.717729 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.718018 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.718127 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.718466 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.718555 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.718778 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.718867 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.719095 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.719183 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.719435 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.719536 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.719751 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.719839 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.720066 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.720162 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.720387 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.720469 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.720698 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.720784 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.721012 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.721186 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.721320 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.721407 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.721634 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.721733 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-3-iscsi {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.722065 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-3-iscsi {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.722161 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.722379 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.722480 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.722695 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.722780 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.723015 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.723157 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.723407 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.723506 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.723721 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.723810 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.724033 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.724129 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.724355 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.724491 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.724669 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.724764 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.724979 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.725066 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.725315 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.725409 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.725637 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.725730 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.725983 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.726080 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.726289 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.726378 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.726676 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.726816 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.727007 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.727176 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.727347 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.727517 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.727517 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.727826 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.727964 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.728088 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.728214 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.728330 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.728444 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.728574 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.728689 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.728813 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.728991 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.729110 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.729314 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.729447 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.729568 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.729681 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.729825 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.729955 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.730135 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.730256 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.730458 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.730589 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.730808 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.730928 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.731192 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.731365 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.731511 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.731691 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.731812 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.732006 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.732127 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.732325 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.732514 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.732703 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.732869 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.733059 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.733211 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.733352 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.733490 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.733615 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.733742 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.733932 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.734070 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.734195 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.734331 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.734494 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.734683 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.734829 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.734953 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.735218 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.735349 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.735492 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.735632 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.735757 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.735893 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.736098 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.736193 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.736418 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.736513 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.736730 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.736817 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.737052 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.737138 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.737372 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.737472 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.737684 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.737772 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.738020 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.738118 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.738330 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.738429 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.738651 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.738737 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.738990 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.739085 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.739301 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.739388 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.739553 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.739639 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.739861 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.739953 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.740170 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.740257 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.740491 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.740576 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.740798 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.740884 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.741108 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.741202 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.741417 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.741515 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.741718 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.741844 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.742051 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.742141 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.742361 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.742446 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.742668 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.742755 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.742979 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.743073 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.743286 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.743372 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.743593 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.743687 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.743898 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.743990 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.744208 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.744295 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.744516 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.744616 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.744834 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.744922 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.745156 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.745242 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.745471 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.745595 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.745779 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.745975 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.746110 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.746207 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.746455 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.746554 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.746777 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.746861 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.747088 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.747181 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.747402 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.747499 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.747727 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.747815 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.748037 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.748123 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.748346 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.748443 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.748668 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.748756 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.748977 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.749070 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.749285 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.749383 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.749604 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.749691 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.749931 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.750033 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.750497 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.750600 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.750813 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.750905 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.751123 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.751216 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.751431 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.751517 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.751736 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.751821 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.752041 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.752127 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.752349 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.752435 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.752654 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.752739 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.752958 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.753049 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.753265 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.753353 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.753565 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.753652 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.753912 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.754004 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.754234 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.754322 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.754544 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.754630 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.754855 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.754954 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.755167 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.755261 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.755487 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.755573 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:00.755830 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.755930 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.756166 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.756252 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.756510 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.756595 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.756829 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.756926 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.757165 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.757253 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.757497 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.757590 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.757839 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.757929 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.758160 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.758248 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.758481 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.758580 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.758809 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.758902 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.759126 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.759214 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.759443 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.759528 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.759757 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.759852 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.760082 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.760176 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.760405 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.760490 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.760735 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.760847 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.761058 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.761147 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.761378 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.761465 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.761700 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.761777 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.762650 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.762749 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.762986 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.763208 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.763318 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.763402 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.763635 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.763724 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.763952 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.764040 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.764301 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.764392 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.764651 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.764739 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.764972 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.765076 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.765299 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.765386 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.765622 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.765725 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.765967 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.766075 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.766286 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.766375 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.766600 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.766686 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.766918 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.767019 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.767252 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.767340 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.767569 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.767662 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.767886 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.767981 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.768224 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.768312 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.768550 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.768637 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.768868 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.768963 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.769181 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.769276 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.769494 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.769581 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.769831 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.769935 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.770143 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.770230 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.770453 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.770547 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.770774 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.770862 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.771104 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.771192 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.771414 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.771502 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.771753 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.771843 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.772063 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.772157 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.772377 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.772472 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.772694 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.772782 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.773003 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.773089 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.773321 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.773416 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.773634 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.773721 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.773969 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.774072 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.774297 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.774395 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.774614 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.774711 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.774924 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.775051 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.775247 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.775344 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.775556 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.775643 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.775863 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.775950 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.776183 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.776277 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.776495 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.776589 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.776811 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.776899 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.777126 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.777224 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.777451 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.777607 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.778398 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.778517 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.778722 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.778822 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.779077 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.779171 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.779437 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.779547 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.779760 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.779921 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.780090 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.780177 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.780422 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.780518 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.780741 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.780835 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.781051 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.781139 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.781366 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.781467 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.781675 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.781825 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.782013 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.782101 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.782323 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.782425 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.782637 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.782723 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.782950 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.783038 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.783264 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.783361 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.783574 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.783663 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.783881 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.784057 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.784174 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.784257 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.784505 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.784600 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.784818 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.784915 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.785127 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.785217 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.785439 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.785534 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.785752 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.785894 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.786128 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.786228 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.786440 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.786528 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.786784 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.786871 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.787123 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.787213 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.787448 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.787536 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.787775 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.787872 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.788090 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.788178 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.788410 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.788498 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.788723 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.788819 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.789037 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.789125 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.789350 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.789438 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.789665 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.789761 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.790014 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.790114 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.790331 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.790420 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.790654 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.790755 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.790968 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.791068 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.791292 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.791379 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.791606 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.791695 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.791928 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.792081 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.792238 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.792326 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.792556 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.792644 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.792898 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.792985 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.793759 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.793885 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.794107 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.794320 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.794438 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.794654 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.794758 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.794972 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.795069 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.795293 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.795382 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.795617 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.795707 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.795934 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.796031 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.796251 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.796346 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.796567 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.796662 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.796891 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.796979 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.797206 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.797295 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.797522 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.797617 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.797862 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.797953 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.798179 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.798266 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.798492 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.798577 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.798807 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.798905 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.799112 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.799198 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.799432 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.799973 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.800074 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.800157 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.800237 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.800317 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.800403 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.800493 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.800684 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.800772 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.801007 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.801102 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.801321 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.801417 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.801631 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.801726 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.801971 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.802107 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.802281 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.802368 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.802593 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.802681 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.802908 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.802995 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.803227 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.803322 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.803541 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.803627 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.803852 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.803939 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.804161 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.804249 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.804477 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.804571 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.804788 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.804875 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.805097 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.805187 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.805407 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.805503 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.805730 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.805841 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.806074 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.806163 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.806388 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.806476 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.806712 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.806800 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.807021 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.807109 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.807332 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.807418 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.807641 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.807729 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.807963 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.808061 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.808275 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.808362 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.808583 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.808683 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.809456 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.809558 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.809770 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.809966 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.810115 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.810209 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.810441 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.810550 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.810751 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.810882 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.811073 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.811214 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.811399 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.811534 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.811713 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.811860 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.812031 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.812180 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.812346 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.812499 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.812660 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.812829 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.812986 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.813153 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.813303 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.813471 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.813616 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.813807 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.813954 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.814131 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.814270 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.814451 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.814585 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.814770 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.814900 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.815101 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.815224 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.815420 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.815542 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.815743 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.815879 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.816063 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.816152 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.816373 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.816464 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.816692 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.816790 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.817017 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.817109 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.817610 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.817701 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.817966 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.818079 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.818288 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.818382 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.818611 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.818706 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.818933 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.819027 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.819256 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.819357 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.819590 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.819704 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.819922 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.820011 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.820239 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.820329 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.820548 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.820646 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.820861 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.820948 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.821164 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.821258 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.821473 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.821569 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.821840 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.821944 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.822127 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.822224 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.822442 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.822543 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.822754 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.822841 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.823067 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.823162 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.823373 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.823462 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.823682 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.823769 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.824026 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.824112 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.824330 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.824549 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.824720 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.824841 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.825064 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.825142 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.825381 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.825478 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.825691 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.825814 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.826045 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.826147 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.826358 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.826461 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.826666 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.826764 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.826974 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.827064 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.827282 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.827371 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.827628 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.827717 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.827934 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.828021 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.828273 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.828361 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.828603 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.828693 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.828946 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.829079 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.829258 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.829347 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.829566 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.829655 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.829916 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.830011 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.830226 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.830328 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.830534 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.830738 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.830902 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.831082 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.831253 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.831439 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.831611 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.831779 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.831899 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.832014 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.832129 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.832259 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.832376 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.832538 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.832658 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.832774 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.832944 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.833164 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.833282 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.833442 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.833561 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.833685 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.833865 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.834000 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.834185 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.834307 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.834498 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.834620 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.834806 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.834927 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.835112 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.835231 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.835431 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.835553 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.835740 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.835859 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.836047 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.836157 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.836371 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.836572 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.836760 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.836940 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.837093 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.837226 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.837354 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.837490 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.837620 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.837746 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.837963 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.838091 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.838218 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.838351 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.838487 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.838621 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.838748 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.838875 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.839083 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.839231 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.839398 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.839531 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.839706 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.839827 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.840030 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.840926 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.840926 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.841059 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.841126 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.841198 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.841416 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.841496 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.841733 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.841844 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.842082 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.842172 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.842403 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.842493 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.842711 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.842802 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.843022 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.843110 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.843329 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.843418 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.843637 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.843729 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.843947 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.844034 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.844257 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.844345 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.844580 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.844686 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.844869 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.844971 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.845174 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.845260 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.845479 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.845567 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.845844 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.846023 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.846114 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.846217 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.846517 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.846629 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.846739 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.846836 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.847047 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.847136 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.847353 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.847447 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.847700 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.847797 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.848008 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.848097 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.848372 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.848460 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.848679 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.848773 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.848998 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.849087 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.849320 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.849409 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.849637 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.849725 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.849974 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.850063 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.850293 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.850382 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.850602 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.850698 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.850919 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.851013 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.851233 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.851329 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.851551 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.851641 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.851859 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.851947 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.852165 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.852260 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.852486 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.852574 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.852802 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.852891 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.853116 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.853212 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.853440 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.853529 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.853767 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.853889 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.854114 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.854214 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.854422 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.854518 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.854736 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.854824 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.855047 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.855142 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.855364 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.855452 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.855740 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.856559 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.856746 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.856826 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.856895 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.856966 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.857154 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.857255 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.857468 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.857559 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.857801 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.857893 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.858114 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.858203 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.858423 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.858525 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.858738 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.858828 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.859051 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.859139 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.859359 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.859455 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.859686 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.859782 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.860000 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.860088 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.860310 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.860397 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.860621 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.860709 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.860930 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.861026 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.861241 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.861336 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.861551 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.861645 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.862018 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.862121 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.862335 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.862424 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.862651 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.862739 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.862961 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.863132 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.863273 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.863350 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.863585 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.863674 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.863905 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.864002 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.864223 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.864319 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.864532 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.864618 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.864946 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.865035 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.865262 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.865349 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.865572 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.865659 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.865914 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.866004 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.866221 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.866307 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.866527 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.866613 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.866836 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.866924 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.867217 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.867327 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.867463 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.867552 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.867767 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.867864 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.868073 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.868162 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.868396 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.868498 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.868703 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.868792 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.869027 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.869114 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.869439 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.869534 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.869754 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.869875 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.870084 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.870173 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.870500 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.870602 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.870814 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.870903 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.871128 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.871225 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.871486 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.871585 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.871788 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.872020 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.872107 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.872188 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.872406 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.872503 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.872721 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.872811 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.873034 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.873129 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.873357 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.873447 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.873682 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.873778 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.874020 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.874110 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.874337 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.874427 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.874644 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.874732 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.874973 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.875069 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.875565 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.875657 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.875885 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.875971 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.876207 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.876303 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.876623 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.876709 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.876944 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.877056 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.877272 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.877405 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.877581 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.877680 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.877935 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.878026 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.878242 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.878368 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.878547 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.878653 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.878858 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.878954 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.879164 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.879253 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.879472 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.879569 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.879798 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.879886 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.880104 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.880191 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.880420 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.880517 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.880733 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.880830 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.881047 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.881136 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.881353 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.881443 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.881659 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.881747 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.882007 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.882097 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.882320 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.882451 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.882711 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.882812 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.882963 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.883042 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.883293 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.883373 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.883632 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.883731 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.883937 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.884043 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.884258 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.884338 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.884571 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.884648 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.884880 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.884965 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.885186 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.885262 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.885491 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.885568 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.885855 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.885952 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.886172 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.886303 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.886494 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.886571 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.886826 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.886960 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.887250 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.887333 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.887571 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.887649 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.887911 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.888018 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.888242 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.888357 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.888560 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.888683 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.888882 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.889010 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.889209 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.889349 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.889655 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.889747 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.889875 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.889989 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.890151 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.890308 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.890513 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.890626 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.890764 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.890940 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.891071 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.891258 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.891393 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.891572 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.891661 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.891882 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.891958 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.892191 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.892283 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.892501 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.892591 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.892832 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.892921 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.893144 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.893233 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.893470 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.893558 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.893778 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.893881 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.894105 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.894196 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.894413 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.894504 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.894723 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.894811 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.895057 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.895145 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.895375 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.895463 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.895707 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.895795 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.896030 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.896131 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.896372 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.896546 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.896675 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.896765 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.897001 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.897098 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.897319 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.897408 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.897638 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.897726 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.897981 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.898087 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.898299 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.898389 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.898616 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.898705 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.898935 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.899037 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.899250 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.899337 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.899563 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.899659 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.899879 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.900012 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.900194 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.900290 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.900514 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.900660 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.900838 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.901089 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.901401 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.901491 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.901722 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.901830 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.902071 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.902168 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.902394 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.902490 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.903227 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.903377 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.903546 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.903788 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.903876 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.904115 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.904204 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.904439 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.904529 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.904761 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.904849 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.905082 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.905170 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.905403 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.905499 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.905730 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.905951 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.906110 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.906209 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.906431 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.906520 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.906752 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.906842 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.907070 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.907167 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.907396 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.907483 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.907735 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.907889 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.908060 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.908163 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.908366 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.908455 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.908684 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.908780 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.909004 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.909100 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.909321 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.909410 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.909638 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.909726 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.909986 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.910087 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.910300 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.910429 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.910615 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.910712 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.910929 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.911017 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.911244 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.911332 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.911560 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.911729 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.911875 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.911962 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.912194 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.912281 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.912515 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.912616 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.912837 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.912924 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.913152 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.913241 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.913469 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.913559 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.913809 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.913902 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.914138 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.914326 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.914464 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.914643 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.914983 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.915070 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.915301 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.915388 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.915627 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.915715 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.915950 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.916063 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.916278 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.916374 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.916590 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.916682 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.916896 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.916987 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.917204 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.917311 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.917517 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.917609 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.917846 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.917948 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.918180 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.918856 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.919017 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.919103 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.919383 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.919481 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.919692 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.919862 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.920062 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.920162 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.920332 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.920432 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.920656 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.920868 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.920958 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.921218 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.921497 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.921588 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.921875 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.921968 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.922203 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.922292 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.922521 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.922607 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.922831 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.922920 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.923155 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.923243 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.923464 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.923551 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.923771 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.923859 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.924089 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.924178 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.924397 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.924492 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.924704 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.924793 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.925018 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.925106 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.925325 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.925422 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.925637 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.925732 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.925969 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.926059 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.926284 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.926385 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.926589 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.926678 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.926905 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.926993 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.927212 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.927312 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.927528 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.927668 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.927825 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.927914 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.928135 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.928235 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.928441 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.928527 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.928749 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.928845 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.929057 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.929145 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.929362 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.929461 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.929673 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.929760 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.930002 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.930101 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.930318 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.930407 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.930624 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.930719 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.930934 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.931022 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.931241 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.931330 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.931553 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.931642 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.931859 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.931950 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.932173 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.932260 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.932479 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.932575 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.932785 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.932874 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.933100 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.933189 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.933411 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.933509 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.933733 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.933890 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.934114 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.934202 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.934426 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.934543 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.934771 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.935025 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.935211 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.935380 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.935551 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.935747 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.935879 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.936022 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.936317 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.936442 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.936690 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.936813 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.937019 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.937140 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.937335 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.937455 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.937646 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.937764 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.937985 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.938095 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.938314 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.938452 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.938630 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.938754 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.938946 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.939076 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.939259 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.939381 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.939574 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.939696 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.939890 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.940057 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.940232 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.940489 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.940489 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.940819 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.940953 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.941129 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.941262 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.941404 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.941404 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.941639 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.941767 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.941985 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.942115 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.942263 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.942392 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.942521 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.942705 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.942840 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.943021 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.943152 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.943338 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.943636 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.943636 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.943812 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.943956 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.944047 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.944275 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.944363 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.944595 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.944754 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.944921 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.945010 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.945231 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.945319 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.945564 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.945666 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.945912 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.946007 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.946305 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.946394 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.946631 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.946729 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.946947 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.947035 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.947273 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.947361 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.947593 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.947699 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.947908 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.947997 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.948232 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.948320 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.948548 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.948638 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.948873 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.948960 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.949201 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.949297 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.949611 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.949705 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.949966 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.950057 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.950280 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.950369 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.950589 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.950695 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.950897 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.951011 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.951211 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.951310 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.951546 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.951636 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.951867 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.951957 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.952191 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.952289 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.952507 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.952597 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.952831 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.952929 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.953145 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.953242 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.953471 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.953560 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.953824 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.953926 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.954148 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.954245 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.954463 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.954559 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.954788 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.954876 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.955109 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.955198 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.955421 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.955508 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.955738 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.955827 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.956055 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.956146 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.956370 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.956459 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.956686 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.956773 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.957006 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.957096 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.957325 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.957414 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.957631 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.957717 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.957983 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.958075 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.958307 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.958394 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.958629 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.958729 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.958949 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.959044 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.959265 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.959353 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.959594 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.959690 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.959905 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.959993 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.960225 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.960321 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.960540 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.960678 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.960855 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.960943 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.961170 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.961256 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.961488 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.961576 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.961826 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.961917 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.962153 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.962242 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.962479 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.962567 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.962808 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.962897 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.963137 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.963231 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.963459 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.963547 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.963812 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.963902 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.964131 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.964230 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.964377 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 08:31:00.964472 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.964810 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:00.965573 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 08:31:00.988699 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_db.sqlalchemy.engines [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:00.991782 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG oslo_db.sqlalchemy.engines [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:01.168524 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.context [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53658e27-76fc-4752-a30c-0afc17fb2e9d(cell1) {{(pid=107422) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 08:31:01.172626 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.context [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53658e27-76fc-4752-a30c-0afc17fb2e9d(cell1) {{(pid=107421) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 08:31:01.172952 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG oslo_concurrency.lockutils [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:31:01.174607 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG oslo_concurrency.lockutils [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:31:01.175424 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG oslo_concurrency.lockutils [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:31:01.176991 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:31:01.177371 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG oslo_concurrency.lockutils [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:31:01.178639 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:31:01.179479 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:31:01.181395 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:31:01.188270 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG oslo_db.sqlalchemy.engines [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:01.190981 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG oslo_db.sqlalchemy.engines [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:01.196146 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_db.sqlalchemy.engines [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:01.201829 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_db.sqlalchemy.engines [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:01.466226 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_db.sqlalchemy.engines [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:01.469263 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG oslo_db.sqlalchemy.engines [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:01.820888 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: WARNING keystonemiddleware.auth_token [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:31:01.828412 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: WARNING keystonemiddleware.auth_token [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:31:01.833267 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: WARNING keystonemiddleware.auth_token [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:31:01.839771 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: WARNING keystonemiddleware.auth_token [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:31:02.183080 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: WARNING keystonemiddleware.auth_token [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:31:02.188658 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: WARNING keystonemiddleware.auth_token [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:31:02.195141 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647456e39c0 pid: 107422 (default app) Oct 28 08:31:02.197363 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:31:02.198596 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] 10.222.0.74 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001894 Oct 28 08:31:02.199016 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 1/1] 10.222.0.74 () {50 vars in 788 bytes} [Thu Oct 28 08:31:02 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:31:02.212068 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: WARNING keystonemiddleware.auth_token [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:31:02.218149 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: WARNING keystonemiddleware.auth_token [None req-7779c4c4-1bfd-4454-a020-f9de98a2b37d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:31:02.225057 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647456e39c0 pid: 107421 (default app) Oct 28 08:32:27.777161 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:27.779399 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Oct 28 08:32:27.792072 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 2/2] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:27 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:28.249760 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-68e0e6c2-4938-45c9-a181-b85e3ff0615b admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:28.282363 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-68e0e6c2-4938-45c9-a181-b85e3ff0615b admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.478600 Oct 28 08:32:28.283914 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 1/3] 10.222.0.74 () {60 vars in 1291 bytes} [Thu Oct 28 08:32:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:32:30.756186 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:30.757168 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-ee430ef4-cc61-4efd-a8bf-0ed4fdd09d7a None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Oct 28 08:32:30.757567 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 3/4] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:30.824964 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-585c0d40-9102-4117-a0ee-c424ac3e075c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "disk": 1, "name": "cirros256"}} {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:30.843904 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:32:30.843904 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: warnings.warn(msg) Oct 28 08:32:30.875574 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-585c0d40-9102-4117-a0ee-c424ac3e075c admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109456 Oct 28 08:32:30.876167 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 2/5] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:30 2021] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:32:31.111368 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-5bf8bc81-8e4a-4163-8566-35e002657c7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:31.113615 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:32:31.113615 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: warnings.warn(msg) Oct 28 08:32:31.170604 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-5bf8bc81-8e4a-4163-8566-35e002657c7d admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284679 Oct 28 08:32:31.177991 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 4/6] 10.222.0.74 () {64 vars in 1335 bytes} [Thu Oct 28 08:32:30 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:32:33.641704 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-585c0d40-9102-4117-a0ee-c424ac3e075c admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:33.642758 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-585c0d40-9102-4117-a0ee-c424ac3e075c admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 28 08:32:33.643374 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 3/7] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:33.765396 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-0793c4f0-28bf-41e2-90e3-fc6633b6e694 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "swap": 0, "ram": 512, "disk": 5}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:33.783614 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:32:33.783614 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: warnings.warn(msg) Oct 28 08:32:33.812139 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-0793c4f0-28bf-41e2-90e3-fc6633b6e694 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.161836 Oct 28 08:32:33.812876 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 5/8] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:32:33.828369 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-7d913333-6f6d-4b98-a185-514a4a38b8df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:33.828979 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:32:33.828979 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: warnings.warn(msg) Oct 28 08:32:33.868810 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-7d913333-6f6d-4b98-a185-514a4a38b8df admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045553 Oct 28 08:32:33.869411 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 4/9] 10.222.0.74 () {64 vars in 1335 bytes} [Thu Oct 28 08:32:33 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:32:36.371086 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-0793c4f0-28bf-41e2-90e3-fc6633b6e694 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:36.372093 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-0793c4f0-28bf-41e2-90e3-fc6633b6e694 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 28 08:32:36.372497 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 6/10] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:36.441977 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-5c388949-1103-4d97-808c-5d41fa1b15a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "id": "d2", "name": "ds1G"}} {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:36.465827 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-5c388949-1103-4d97-808c-5d41fa1b15a9 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086032 Oct 28 08:32:36.466384 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 5/11] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:32:36.479566 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-b214991b-2963-40be-9fd0-a95ab2286eb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:36.507344 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-b214991b-2963-40be-9fd0-a95ab2286eb9 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031902 Oct 28 08:32:36.508594 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 7/12] 10.222.0.74 () {64 vars in 1335 bytes} [Thu Oct 28 08:32:36 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:32:38.941017 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-5c388949-1103-4d97-808c-5d41fa1b15a9 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:38.942099 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-5c388949-1103-4d97-808c-5d41fa1b15a9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 28 08:32:38.942502 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 6/13] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:39.013501 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-ef45638c-b125-4d2a-930a-c4050681e3f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "ram": 2048}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:39.033619 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-ef45638c-b125-4d2a-930a-c4050681e3f0 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082994 Oct 28 08:32:39.034267 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 8/14] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:32:39.049102 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-fca18231-2586-4203-9329-bdc2569574eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:39.084896 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-fca18231-2586-4203-9329-bdc2569574eb admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041515 Oct 28 08:32:39.090390 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 7/15] 10.222.0.74 () {64 vars in 1335 bytes} [Thu Oct 28 08:32:39 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:32:41.458221 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-ef45638c-b125-4d2a-930a-c4050681e3f0 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:41.459225 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-ef45638c-b125-4d2a-930a-c4050681e3f0 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Oct 28 08:32:41.459611 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 9/16] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:32:41.531050 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-ae32e22f-5bb7-4689-89cc-6cd804906fc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:41.552674 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-ae32e22f-5bb7-4689-89cc-6cd804906fc5 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084038 Oct 28 08:32:41.553216 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 8/17] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:32:41.566320 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-d6b330e5-5720-4bbe-b43f-22cb37dfef6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:41.593676 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-d6b330e5-5720-4bbe-b43f-22cb37dfef6a admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031106 Oct 28 08:32:41.594411 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 10/18] 10.222.0.74 () {64 vars in 1335 bytes} [Thu Oct 28 08:32:41 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:32:43.962620 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-ae32e22f-5bb7-4689-89cc-6cd804906fc5 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:43.963692 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-ae32e22f-5bb7-4689-89cc-6cd804906fc5 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 28 08:32:43.965480 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 9/19] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:43 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:44.052254 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-2c3dd3c0-8f2c-43f0-b8d7-cdcf46bc7945 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:44.097034 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-2c3dd3c0-8f2c-43f0-b8d7-cdcf46bc7945 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.123181 Oct 28 08:32:44.102264 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 11/20] 10.222.0.74 () {60 vars in 1291 bytes} [Thu Oct 28 08:32:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:32:46.733129 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-ae32e22f-5bb7-4689-89cc-6cd804906fc5 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:46.734185 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-ae32e22f-5bb7-4689-89cc-6cd804906fc5 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 28 08:32:46.734608 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 10/21] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:46.799941 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-df309618-aab4-499e-8b12-b4e016cecdfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "swap": 0, "name": "m1.tiny", "ram": 512}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:46.821125 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-df309618-aab4-499e-8b12-b4e016cecdfd admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077749 Oct 28 08:32:46.822290 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 12/22] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:46 2021] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:32:46.836862 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-9656d60c-2f87-4a0c-9b58-41101e64ffd5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:46.864189 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-9656d60c-2f87-4a0c-9b58-41101e64ffd5 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032197 Oct 28 08:32:46.864778 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 11/23] 10.222.0.74 () {64 vars in 1332 bytes} [Thu Oct 28 08:32:46 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:32:49.370733 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-df309618-aab4-499e-8b12-b4e016cecdfd admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:49.371745 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-df309618-aab4-499e-8b12-b4e016cecdfd admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 28 08:32:49.372173 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 13/24] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:49.433682 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-ad990605-3a5b-4a56-bd14-cd4623de7402 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "swap": 0}} {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:49.456533 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-ad990605-3a5b-4a56-bd14-cd4623de7402 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077689 Oct 28 08:32:49.457091 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 12/25] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:49 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:32:49.470675 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-7daecd09-a00b-4d4b-a732-56011aaa374e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:49.497847 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-7daecd09-a00b-4d4b-a732-56011aaa374e admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028946 Oct 28 08:32:49.498743 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 14/26] 10.222.0.74 () {64 vars in 1332 bytes} [Thu Oct 28 08:32:49 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:32:51.928870 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-ad990605-3a5b-4a56-bd14-cd4623de7402 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:51.929948 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-ad990605-3a5b-4a56-bd14-cd4623de7402 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Oct 28 08:32:51.930354 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 13/27] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:51.994613 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-b6dab059-2fe3-4b39-9408-039f2ab9b275 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "swap": 0}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:52.016740 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-b6dab059-2fe3-4b39-9408-039f2ab9b275 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077897 Oct 28 08:32:52.017289 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 15/28] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:51 2021] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:32:52.030171 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-816ec85e-85ed-42ef-8bf8-0ddac7d23dee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:52.063636 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-816ec85e-85ed-42ef-8bf8-0ddac7d23dee admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037614 Oct 28 08:32:52.064433 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 14/29] 10.222.0.74 () {64 vars in 1332 bytes} [Thu Oct 28 08:32:52 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:32:54.481218 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-b6dab059-2fe3-4b39-9408-039f2ab9b275 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:54.482258 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-b6dab059-2fe3-4b39-9408-039f2ab9b275 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 28 08:32:54.482844 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 16/30] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:54.546972 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-28879a74-3792-4850-8008-181622419b42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80}} {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:54.571235 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-28879a74-3792-4850-8008-181622419b42 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081502 Oct 28 08:32:54.572096 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 15/31] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:54 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:32:54.586508 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-ed929409-fea1-4190-97ec-f687f09f5b0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:54.613953 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-ed929409-fea1-4190-97ec-f687f09f5b0c admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031005 Oct 28 08:32:54.615276 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 17/32] 10.222.0.74 () {64 vars in 1332 bytes} [Thu Oct 28 08:32:54 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:32:57.110019 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-28879a74-3792-4850-8008-181622419b42 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:57.111046 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-28879a74-3792-4850-8008-181622419b42 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 28 08:32:57.111471 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 16/33] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:32:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:57.185645 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-bdf03254-b7db-49b8-888b-84c64f877983 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "id": "5", "vcpus": 8, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:57.209725 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-bdf03254-b7db-49b8-888b-84c64f877983 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.090072 Oct 28 08:32:57.210721 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 18/34] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:57 2021] POST /compute/v2.1/flavors => generated 408 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:32:57.226282 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-fe6b5236-6177-44c4-8e74-2c6922e63f2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:57.255156 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-fe6b5236-6177-44c4-8e74-2c6922e63f2b admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032499 Oct 28 08:32:57.255737 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 17/35] 10.222.0.74 () {64 vars in 1332 bytes} [Thu Oct 28 08:32:57 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:33:38.297590 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-bdf03254-b7db-49b8-888b-84c64f877983 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:38.298661 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-bdf03254-b7db-49b8-888b-84c64f877983 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 28 08:33:38.299055 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 19/36] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:33:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:38.362449 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-cc5ad114-c7ec-48c3-b97a-03ff0ed36425 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:38.380242 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-cc5ad114-c7ec-48c3-b97a-03ff0ed36425 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074522 Oct 28 08:33:38.380780 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 18/37] 10.222.0.74 () {60 vars in 1291 bytes} [Thu Oct 28 08:33:38 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:39.951320 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-bdf03254-b7db-49b8-888b-84c64f877983 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:39.952885 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-bdf03254-b7db-49b8-888b-84c64f877983 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001928 Oct 28 08:33:39.953509 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 20/38] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:33:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:33:40.153681 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-ad80e3b1-ff6b-425b-a6f5-952c1ec3dcce admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:40.162583 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.wsgi [None req-ad80e3b1-ff6b-425b-a6f5-952c1ec3dcce admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 08:33:40.163136 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-ad80e3b1-ff6b-425b-a6f5-952c1ec3dcce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:33:40.163966 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-ad80e3b1-ff6b-425b-a6f5-952c1ec3dcce admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063889 Oct 28 08:33:40.164524 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 19/39] 10.222.0.74 () {60 vars in 1190 bytes} [Thu Oct 28 08:33:40 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:40.174799 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-a2d0b574-d21a-4caf-b1cb-bd79ab99280e admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:40.196564 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-a2d0b574-d21a-4caf-b1cb-bd79ab99280e admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025327 Oct 28 08:33:40.197108 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 21/40] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Oct 28 08:33:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:40.208626 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-43529fdf-ec53-45b0-b7a8-87f3f7c4a967 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:40.231532 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-43529fdf-ec53-45b0-b7a8-87f3f7c4a967 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026473 Oct 28 08:33:40.232089 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 20/41] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Oct 28 08:33:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:40.242045 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-f4784e24-4a22-4e79-8e55-66f7b63f6a88 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:40.248608 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.wsgi [None req-f4784e24-4a22-4e79-8e55-66f7b63f6a88 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 08:33:40.249164 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-f4784e24-4a22-4e79-8e55-66f7b63f6a88 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:33:40.249983 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-f4784e24-4a22-4e79-8e55-66f7b63f6a88 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011411 Oct 28 08:33:40.250484 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 22/42] 10.222.0.74 () {60 vars in 1190 bytes} [Thu Oct 28 08:33:40 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:41.702412 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-43529fdf-ec53-45b0-b7a8-87f3f7c4a967 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:41.703415 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-43529fdf-ec53-45b0-b7a8-87f3f7c4a967 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 28 08:33:41.703805 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 21/43] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:33:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:41.897132 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-a95a42d7-f1ba-408e-9692-691b51aa1cea admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:41.903175 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.wsgi [None req-a95a42d7-f1ba-408e-9692-691b51aa1cea admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 08:33:41.903733 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-a95a42d7-f1ba-408e-9692-691b51aa1cea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:33:41.904513 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-a95a42d7-f1ba-408e-9692-691b51aa1cea admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061221 Oct 28 08:33:41.905019 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 23/44] 10.222.0.74 () {60 vars in 1190 bytes} [Thu Oct 28 08:33:41 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:41.914782 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-d7129535-a143-48a7-b2e9-af22b61f6973 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:41.928010 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-d7129535-a143-48a7-b2e9-af22b61f6973 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016710 Oct 28 08:33:41.928557 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 22/45] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Oct 28 08:33:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:41.938691 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-b4d95d2e-7e46-4960-819f-73e69e6a3245 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:41.953821 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-b4d95d2e-7e46-4960-819f-73e69e6a3245 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018647 Oct 28 08:33:41.954387 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 24/46] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Oct 28 08:33:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:41.965007 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-b4ea2a24-c7c9-4b6b-892e-0975d27f167f admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:41.970324 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.wsgi [None req-b4ea2a24-c7c9-4b6b-892e-0975d27f167f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 08:33:41.970886 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-b4ea2a24-c7c9-4b6b-892e-0975d27f167f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:33:41.971660 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-b4ea2a24-c7c9-4b6b-892e-0975d27f167f admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010792 Oct 28 08:33:41.972152 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 23/47] 10.222.0.74 () {60 vars in 1190 bytes} [Thu Oct 28 08:33:41 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:43.446658 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-b4d95d2e-7e46-4960-819f-73e69e6a3245 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:43.447657 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-b4d95d2e-7e46-4960-819f-73e69e6a3245 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 28 08:33:43.448055 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 25/48] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:33:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:43.644797 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-7a4fe4b8-ccb4-4e71-9601-40f24904f834 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:43.650566 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.wsgi [None req-7a4fe4b8-ccb4-4e71-9601-40f24904f834 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 08:33:43.651082 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-7a4fe4b8-ccb4-4e71-9601-40f24904f834 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:33:43.652418 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-7a4fe4b8-ccb4-4e71-9601-40f24904f834 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062555 Oct 28 08:33:43.652941 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 24/49] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Oct 28 08:33:43 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:43.662917 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-5eb5d0cb-6ad8-431c-9b8a-09a4242a3450 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:43.678294 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-5eb5d0cb-6ad8-431c-9b8a-09a4242a3450 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018893 Oct 28 08:33:43.678851 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 26/50] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Oct 28 08:33:43 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:43.689112 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:43.703021 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017347 Oct 28 08:33:43.703574 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 25/51] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Oct 28 08:33:43 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:43.713670 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-f9494dff-6a7e-402a-afd5-02f4b9eebd2c admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:43.719850 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.wsgi [None req-f9494dff-6a7e-402a-afd5-02f4b9eebd2c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 08:33:43.720420 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-f9494dff-6a7e-402a-afd5-02f4b9eebd2c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:33:43.721223 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-f9494dff-6a7e-402a-afd5-02f4b9eebd2c admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011211 Oct 28 08:33:43.721749 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 27/52] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Oct 28 08:33:43 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 08:33:45.213245 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:45.214897 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Oct 28 08:33:45.215308 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 26/53] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:33:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:45.412718 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-97b3ed66-0e73-451e-af04-874134155613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:45.439555 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-97b3ed66-0e73-451e-af04-874134155613 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.080575 Oct 28 08:33:45.440018 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 28/54] 10.222.0.74 () {64 vars in 1235 bytes} [Thu Oct 28 08:33:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:33:46.894749 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:46.895765 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 28 08:33:46.896173 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 27/55] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:33:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:47.092297 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-d30433be-aa92-4d87-aea7-a04ddc8578b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:47.112677 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-d30433be-aa92-4d87-aea7-a04ddc8578b5 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073960 Oct 28 08:33:47.113283 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 29/56] 10.222.0.74 () {64 vars in 1235 bytes} [Thu Oct 28 08:33:47 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:33:48.621389 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:48.622429 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 28 08:33:48.622831 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 28/57] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:33:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:48.817422 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-4ede14d1-cf02-4c9c-ad86-906cdac41aa4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:48.836901 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-4ede14d1-cf02-4c9c-ad86-906cdac41aa4 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071947 Oct 28 08:33:48.837364 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 30/58] 10.222.0.74 () {64 vars in 1235 bytes} [Thu Oct 28 08:33:48 2021] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:33:50.291990 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:50.293554 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Oct 28 08:33:50.294001 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 29/59] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:33:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:50.489312 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-6d5eb5b2-0a61-40d6-a39a-50fd6dc1b09e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:50.507251 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-6d5eb5b2-0a61-40d6-a39a-50fd6dc1b09e admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071740 Oct 28 08:33:50.507722 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 31/60] 10.222.0.74 () {64 vars in 1235 bytes} [Thu Oct 28 08:33:50 2021] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:33:51.976778 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:51.977846 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 28 08:33:51.978252 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 30/61] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:33:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:52.175081 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-501ae540-4518-4c2b-b1e6-ec71f7b6ba6d admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:52.193887 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-501ae540-4518-4c2b-b1e6-ec71f7b6ba6d admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072536 Oct 28 08:33:52.194348 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 32/62] 10.222.0.74 () {60 vars in 1202 bytes} [Thu Oct 28 08:33:52 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:34:40.911235 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:40.912333 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-d480794c-2af8-42e6-9361-9beaa0ef310f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Oct 28 08:34:40.912741 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 31/63] 10.222.0.74 () {54 vars in 930 bytes} [Thu Oct 28 08:34:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:34:40.974051 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-d8a3be6d-e916-45c8-b80a-796cdb031efc admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:40.997987 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-d8a3be6d-e916-45c8-b80a-796cdb031efc admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078444 Oct 28 08:34:40.998531 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 33/64] 10.222.0.74 () {60 vars in 1291 bytes} [Thu Oct 28 08:34:40 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:34:41.021455 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-18701f16-b14c-40e9-8eff-dc7e93e79981 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:41.029841 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-18701f16-b14c-40e9-8eff-dc7e93e79981 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011935 Oct 28 08:34:41.030379 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 32/65] 10.222.0.74 () {60 vars in 1282 bytes} [Thu Oct 28 08:34:41 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:34:41.049954 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-732ff49a-bed0-4593-ab20-657c5b89c42c admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:41.057472 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-732ff49a-bed0-4593-ab20-657c5b89c42c admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011096 Oct 28 08:34:41.059232 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 34/66] 10.222.0.74 () {60 vars in 1285 bytes} [Thu Oct 28 08:34:41 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:34:41.070738 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-0f72cf15-fb8e-485e-a578-92cc2144d4ec admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:41.078958 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-0f72cf15-fb8e-485e-a578-92cc2144d4ec admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011808 Oct 28 08:34:41.079484 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 33/67] 10.222.0.74 () {60 vars in 1285 bytes} [Thu Oct 28 08:34:41 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:34:41.093185 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-bfa2a6d5-e809-4a0b-88b0-11baa3f90cd9 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:41.101149 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-bfa2a6d5-e809-4a0b-88b0-11baa3f90cd9 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012373 Oct 28 08:34:41.101702 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 35/68] 10.222.0.74 () {60 vars in 1282 bytes} [Thu Oct 28 08:34:41 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:36:03.918111 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-7b5dce90-ed72-45e7-835a-f5c987ecd1aa tempest-verify_tempest_config-1365981395 tempest-verify_tempest_config-1365981395-project] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:36:03.920158 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-7b5dce90-ed72-45e7-835a-f5c987ecd1aa tempest-verify_tempest_config-1365981395 tempest-verify_tempest_config-1365981395-project] 10.222.0.74 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.119859 Oct 28 08:36:03.920696 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 34/69] 10.222.0.74 () {58 vars in 1133 bytes} [Thu Oct 28 08:36:03 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:37:40.857309 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-bfa2a6d5-e809-4a0b-88b0-11baa3f90cd9 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:40.858390 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-bfa2a6d5-e809-4a0b-88b0-11baa3f90cd9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Oct 28 08:37:40.858808 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 36/70] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:37:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:37:41.133502 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-6a175db6-edde-4903-b49a-622d53fbebf4 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:41.134702 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:37:41.134702 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: warnings.warn(msg) Oct 28 08:37:41.136292 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-6a175db6-edde-4903-b49a-622d53fbebf4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:41.136991 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-6a175db6-edde-4903-b49a-622d53fbebf4 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:41.138002 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-6a175db6-edde-4903-b49a-622d53fbebf4 admin admin] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:41.138584 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-6a175db6-edde-4903-b49a-622d53fbebf4 admin admin] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:41.177006 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-6a175db6-edde-4903-b49a-622d53fbebf4 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.162344 Oct 28 08:37:41.177583 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 35/71] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Oct 28 08:37:41 2021] GET /compute/v2.1/os-services => generated 791 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:37:42.657053 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-bfa2a6d5-e809-4a0b-88b0-11baa3f90cd9 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:42.658093 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-bfa2a6d5-e809-4a0b-88b0-11baa3f90cd9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 28 08:37:42.658500 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 37/72] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:37:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:37:42.859153 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-f6644448-1775-47f7-8a5b-325533b64113 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:42.860293 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:37:42.860293 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: warnings.warn(msg) Oct 28 08:37:42.861776 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-f6644448-1775-47f7-8a5b-325533b64113 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:42.862289 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-f6644448-1775-47f7-8a5b-325533b64113 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:42.863034 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-f6644448-1775-47f7-8a5b-325533b64113 admin admin] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:42.863478 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-f6644448-1775-47f7-8a5b-325533b64113 admin admin] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:42.884160 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-f6644448-1775-47f7-8a5b-325533b64113 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079087 Oct 28 08:37:42.884736 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 36/73] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Oct 28 08:37:42 2021] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:37:54.851501 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-bfa2a6d5-e809-4a0b-88b0-11baa3f90cd9 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:54.852574 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-bfa2a6d5-e809-4a0b-88b0-11baa3f90cd9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 28 08:37:54.852996 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 38/74] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:37:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:37:55.050051 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-e1b533e2-f644-4278-be94-f72a635f0a62 admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:55.051305 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:37:55.051305 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: warnings.warn(msg) Oct 28 08:37:55.052836 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-e1b533e2-f644-4278-be94-f72a635f0a62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:55.053276 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-e1b533e2-f644-4278-be94-f72a635f0a62 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:55.054104 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-e1b533e2-f644-4278-be94-f72a635f0a62 admin admin] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:55.054561 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-e1b533e2-f644-4278-be94-f72a635f0a62 admin admin] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:55.080321 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-e1b533e2-f644-4278-be94-f72a635f0a62 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083746 Oct 28 08:37:55.080884 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 37/75] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Oct 28 08:37:54 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:37:56.616375 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: DEBUG nova.api.openstack.wsgi [None req-bfa2a6d5-e809-4a0b-88b0-11baa3f90cd9 admin admin] Calling method '>' {{(pid=107422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:56.617365 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: INFO nova.api.openstack.requestlog [None req-bfa2a6d5-e809-4a0b-88b0-11baa3f90cd9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Oct 28 08:37:56.617759 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: [pid: 107422|app: 0|req: 39/76] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Oct 28 08:37:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:37:56.837363 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG nova.api.openstack.wsgi [None req-caf2b8ea-52b1-49ef-bdc5-de208085116b admin admin] Calling method '>' {{(pid=107421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:56.838763 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:37:56.838763 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: warnings.warn(msg) Oct 28 08:37:56.840312 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-caf2b8ea-52b1-49ef-bdc5-de208085116b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:56.840757 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-caf2b8ea-52b1-49ef-bdc5-de208085116b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:56.841552 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-caf2b8ea-52b1-49ef-bdc5-de208085116b admin admin] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:56.842007 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: DEBUG oslo_concurrency.lockutils [None req-caf2b8ea-52b1-49ef-bdc5-de208085116b admin admin] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:56.865889 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: INFO nova.api.openstack.requestlog [None req-caf2b8ea-52b1-49ef-bdc5-de208085116b admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090996 Oct 28 08:37:56.866446 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: [pid: 107421|app: 0|req: 38/77] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Oct 28 08:37:56 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:38:57.571759 dv-cinder-815660-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 08:38:57.572794 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: Thu Oct 28 08:38:57 2021 - graceful shutdown triggered... Oct 28 08:38:57.573216 dv-cinder-815660-3-iscsi devstack@n-api.service[107421]: Gracefully killing worker 1 (pid: 107421)... Oct 28 08:38:57.573569 dv-cinder-815660-3-iscsi devstack@n-api.service[107422]: Gracefully killing worker 2 (pid: 107422)... Oct 28 08:38:58.572811 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: worker 1 buried after 1 seconds Oct 28 08:38:58.572811 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: worker 2 buried after 1 seconds Oct 28 08:38:58.572811 dv-cinder-815660-3-iscsi devstack@n-api.service[107420]: goodbye to uWSGI. Oct 28 08:38:58.574496 dv-cinder-815660-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 28 08:38:58.575051 dv-cinder-815660-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 08:38:58.577873 dv-cinder-815660-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 08:38:58.587737 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 08:38:58 2021] *** Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: nodename: dv-cinder-815660-3-iscsi Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: machine: x86_64 Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: clock source: unix Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: pcre jit disabled Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: detected number of CPU cores: 4 Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: current working directory: / Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: detected binary path: /usr/bin/uwsgi-core Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: your processes number limit is 47680 Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: your memory page size is 4096 bytes Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: detected max file descriptor number: 2048 Oct 28 08:38:58.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: lock engine: pthread robust mutexes Oct 28 08:38:58.591388 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: thunder lock: enabled Oct 28 08:38:58.591388 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 08:38:58.591388 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 08:38:58.639579 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: Python main interpreter initialized at 0x564ff9bb39c0 Oct 28 08:38:58.639579 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: python threads support enabled Oct 28 08:38:58.639579 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: your server socket listen backlog is limited to 100 connections Oct 28 08:38:58.639579 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: your mercy for graceful operations on workers is 90 seconds Oct 28 08:38:58.640034 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 08:38:58.640034 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: *** Operational MODE: preforking *** Oct 28 08:38:58.640309 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: *** uWSGI is running in multiple interpreter mode *** Oct 28 08:38:58.640309 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: spawned uWSGI master process (pid: 132784) Oct 28 08:38:58.640522 dv-cinder-815660-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 08:38:58.641220 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: spawned uWSGI worker 1 (pid: 132796, cores: 1) Oct 28 08:38:58.642145 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: spawned uWSGI worker 2 (pid: 132797, cores: 1) Oct 28 08:38:58.642145 dv-cinder-815660-3-iscsi devstack@n-api.service[132784]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 08:39:00.485480 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:39:00.485480 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: from cryptography.utils import int_from_bytes Oct 28 08:39:00.486246 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:39:00.486246 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: from cryptography.utils import int_from_bytes Oct 28 08:39:00.587897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:39:00.587897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: from cryptography.utils import int_from_bytes Oct 28 08:39:00.588650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:39:00.588650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: from cryptography.utils import int_from_bytes Oct 28 08:39:03.164652 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 08:39:03.165211 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 08:39:03.165488 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 08:39:03.165754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 08:39:03.166052 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 08:39:03.166451 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.166782 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.167120 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.167427 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.167755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.168085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.168433 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.168722 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.169040 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.169303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.169625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.169976 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-3-iscsi {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.170301 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.170615 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.170929 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.171250 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.171557 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.171880 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.172186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.173384 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.173384 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.173597 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.174138 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.174138 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.174447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.174709 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.175031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.175394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.175787 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.176136 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.176510 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-3-iscsi {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.176842 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.177145 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.177458 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.177941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.178228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.178531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.178856 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.179184 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.179521 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.179830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.180341 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.180662 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.180980 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.181287 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.181609 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.181942 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.182268 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.182579 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.182893 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.183147 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.183454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.183777 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.184100 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.184426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.184680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.184930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.185245 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.185569 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.185899 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.186209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.186516 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.186823 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.187128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.187437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.187739 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.188048 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.188370 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.188686 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.189011 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.189317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.189647 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.190088 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.190341 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.190647 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.191548 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.192085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.192361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.192847 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.193172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.193487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.193818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.194133 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.194456 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.194799 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.195109 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.195363 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.195666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.195978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.196301 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.196609 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.196918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.197229 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.197543 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.197870 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.198186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.198493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.198797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.199103 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.199459 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.199846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.200045 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.200447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.200672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.201052 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.201308 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.201617 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.202173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.202358 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.202642 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.202881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.203325 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.203522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.203869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.204247 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.204422 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.204720 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.205865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.205865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.205865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.206191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.206353 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.207466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.207991 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.208314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.208639 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.208905 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.209204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.209696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.209914 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.210263 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.210529 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.210795 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.211113 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.211437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.211738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.212065 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.212413 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.212799 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.213099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.213418 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.213754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.214115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.214531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.214751 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.215069 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.215401 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.215717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.216032 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.216347 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.216670 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.216994 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.217328 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.217647 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.218036 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.218313 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.218627 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.218947 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.219282 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.219612 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.219927 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.220473 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.220799 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.221140 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.221448 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.221767 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.222122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.222559 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.222966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.223186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.223523 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.223840 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.224154 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.224698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.224874 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.225134 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.225445 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.225754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.226088 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.226406 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.226715 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.227044 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.227383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.227692 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.228032 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.228339 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.228659 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.228977 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.229256 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.229576 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.229917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.230237 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.230719 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.230885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.231185 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.231576 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.231820 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.232130 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.232454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.232773 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.233134 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.233399 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.233735 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.234081 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.234395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.234801 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.235071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.235384 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.235713 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.236045 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.236367 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.236676 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.236992 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.237309 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.237616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.238238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.238238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.238614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.238955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.239238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.239551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.239863 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.240201 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.240515 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.240827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.241138 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.241445 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.241834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.242159 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.242481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.242828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.243148 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.243481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.243800 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.244126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.244439 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.244754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.245068 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.245385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.245708 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.246074 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.246401 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.246719 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.247055 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.247371 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.247695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.248006 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.248335 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.248673 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.249015 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.249335 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.249669 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.250018 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.250340 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.250657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.250972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.251287 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.251602 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.252039 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.252237 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.252561 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.252880 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.253217 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.254286 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.254459 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.254746 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.255153 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.255506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.255847 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.256166 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.256485 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.256814 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.257134 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.257446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.257763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.258117 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.258430 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.258745 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.259070 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.259385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.259699 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.260162 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.260335 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.260696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.260936 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.261266 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.261645 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.262075 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.262406 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.262959 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.262959 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.263351 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.263568 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.263864 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.264696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.264927 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.265127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.265330 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.265676 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.266041 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.266355 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.266679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.267008 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.267331 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.267657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.267967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.268280 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.268711 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.268986 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.269937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.270508 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.270772 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.271118 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.271349 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.271676 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.271989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.272305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.272621 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.272917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.273226 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.273555 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.274183 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.274527 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.274846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.275164 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.275489 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.275813 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.276150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.276483 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.276801 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.277114 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.277429 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.277741 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.278072 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.278388 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.278698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.279010 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.279319 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.279633 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.279949 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.280260 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.280645 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.280908 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.281238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.281549 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.281889 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.282202 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.282536 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.282863 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.283160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.283465 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.283766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.284115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.284424 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.284886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.285259 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.285553 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.285885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.286197 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.286528 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.286837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.287145 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.287453 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.287766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.288077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.288383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.288697 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.289008 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.289321 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.289635 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.289968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.290284 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.290667 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.290932 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.291203 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.291510 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.291816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.292129 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.292440 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.292747 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.293060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.293365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.293684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.294014 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.294322 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.294628 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.294995 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.295250 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.295559 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.295885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.296368 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.296541 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.296806 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.297118 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.297426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.297734 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.298072 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.298399 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.298661 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 08:39:03.299147 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.299296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 08:39:03.299443 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.299443 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.299730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 08:39:03.299886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.300033 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 08:39:03.300190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.300344 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 08:39:03.300758 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.301068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.301232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.301232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.301232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.301773 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.301978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.302127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.302280 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.302436 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.302590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.302749 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.302910 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.303065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.303212 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.303464 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.303635 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.303901 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.304054 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.304203 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.304358 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.304511 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.304666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.304823 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.304991 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.305254 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-3-iscsi {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.305415 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.305687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.308473 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.308661 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.308661 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.308966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.309117 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.309275 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.309424 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.309654 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.309864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.310019 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.310166 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.310311 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.310311 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.310607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.310776 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.310922 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.311259 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.311424 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.311602 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.311854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.312016 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.312163 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.312316 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.312463 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.312623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.312777 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.312930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.313077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.313229 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.321707 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.322084 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.322255 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.322442 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.322593 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.322738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.322902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-3-iscsi {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.323060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.323213 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.323367 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.323514 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.323668 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.323815 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.323960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.323960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.324238 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.324395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.324555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.324710 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.324864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.325018 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.325173 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.325331 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.325484 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.325630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.325811 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.325967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.326123 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.326280 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.326444 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.326600 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.326747 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.326893 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.327039 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.327192 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.327340 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.327494 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.327647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.327793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.327938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.328096 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.328253 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.328400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.328559 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.328712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.328873 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.329020 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.329020 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.329314 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.329462 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.329607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.329765 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.329938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.330084 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.330254 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.330409 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.330562 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.330721 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.330868 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.331033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.331502 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.332652 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.332885 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.333072 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.333230 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.333391 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.333548 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.333702 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.333895 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.334049 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.334196 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.334342 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.334489 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.334643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.334805 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.334952 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.335098 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.335243 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.335404 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.335404 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.335699 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.335846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.335991 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.336145 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.336291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.336291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.336585 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.336585 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.336878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.337025 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.337178 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.337178 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.337482 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.337635 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.337862 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.337862 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.338151 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.338310 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.338458 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.338609 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.338756 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.338902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.339056 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.339221 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.339374 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.339521 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.339666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.339811 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.339965 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.340112 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.340257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.340402 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.340547 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.340692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.340846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.341000 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.341163 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.341709 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.341906 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.342193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.342193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.342888 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.343046 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.343192 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.343345 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.343505 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.343652 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.343818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.344177 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.344328 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.345176 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.345382 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.345543 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.345698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.345912 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.346065 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.346433 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.346598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.346747 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.346893 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.347042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.347405 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.347660 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.347858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.347858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.347858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.348321 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.348470 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.348630 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.348785 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.348938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.349084 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.349239 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.349487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.349650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.349829 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.349996 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.350151 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.350359 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.350523 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.350722 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.350882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.351036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.351182 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.351334 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.351509 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.352021 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.352219 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.352497 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.352650 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.352921 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.353183 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.353343 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.353498 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.353655 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.353845 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.353999 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.354156 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.354311 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.354465 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.354637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.354785 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.354931 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.355077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.355230 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.355386 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.355541 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.355688 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.355833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.355978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.356123 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.356282 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.356429 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.356597 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.356752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.356905 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.357051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.357205 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.357359 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.357504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.357657 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.357831 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.357985 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.358143 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.358304 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.358463 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.358626 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.358626 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.358924 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.359087 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.359239 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.359390 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.359541 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.359692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.359859 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.360013 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.360165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.360324 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.360487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.360639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:03.360802 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.360802 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.361108 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.361270 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.361435 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.361588 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.361769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.362259 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.362259 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.362678 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.362889 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.363149 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.363427 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.363594 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.363755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.363915 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.364071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.364071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.364071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.364530 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.364691 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.364844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.364997 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.365163 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.365359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.365654 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.366041 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.366348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.366630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.366833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.367032 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.367242 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.367442 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.367641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.367857 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.368063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.368284 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.368486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.368695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.368894 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.369200 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.369417 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.369619 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.369852 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.370072 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.370274 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.370486 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.370686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.370901 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.370901 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.371413 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.371733 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.372646 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.373083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.373496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.373934 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.374159 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.374388 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.374616 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.374846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.375078 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.375260 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.375511 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.375679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.375840 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.375840 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.376128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.376289 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.376449 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.376616 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.376770 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.376922 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.377074 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.377231 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.377408 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.377562 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.377713 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.378040 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.378224 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.378380 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.379051 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.379051 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.379347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.379506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.379669 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.379669 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.379968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.380134 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.380293 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.380453 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.380614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.380776 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.380942 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.381095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.381246 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.381398 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.381555 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.381763 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.381968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.382137 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.382424 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.382990 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.383291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.383572 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.383733 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.383909 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.384184 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.384344 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.384511 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.384665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.384817 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.384985 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.385136 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.385295 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.385462 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.385462 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.385770 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.385966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.386123 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.386281 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.386281 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.386581 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.386732 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.386885 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.387048 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.387200 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.387365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.387526 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.387685 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.387844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.387996 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.388163 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.388323 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.388477 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.388636 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.388789 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.388958 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.389123 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.389537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.389691 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.389875 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.390034 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.390034 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.390404 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.390567 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.390728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.393801 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.393985 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.394905 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.395188 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.395365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.395534 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.395690 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.395851 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.396015 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.396176 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.396337 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.396499 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.396659 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.396811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.396978 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.397139 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.397305 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.397465 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.397613 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.397737 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.397865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.397956 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398041 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398209 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398397 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398484 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398575 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398661 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398745 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.398924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.399085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.399179 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.399267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.399388 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.399485 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.399580 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.399675 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.399769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.399864 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400031 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400121 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400214 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400301 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400386 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400480 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400831 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.400926 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401021 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401108 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401193 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401278 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401364 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401456 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401556 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401643 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401841 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.401941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.402184 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.402277 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.402363 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.402456 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.402541 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.402638 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.402726 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.402810 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.402894 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.402978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.403076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.403163 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.403266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.403805 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.403900 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.403995 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404090 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404177 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404270 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404363 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404456 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404714 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404809 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.404996 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.405082 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.405191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.405286 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.405372 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.405464 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.405548 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.405645 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.405731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.405988 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.406097 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.406193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.406279 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.406373 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.406467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.406560 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.406646 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.406730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.406814 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.406910 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407004 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407091 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407177 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407261 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407442 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407442 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407596 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407774 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407870 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.407965 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408052 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408052 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408205 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408205 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408377 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408464 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408549 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408634 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408726 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408812 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408906 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.408906 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.409091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.409176 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.409261 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.409352 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.409447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.409541 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.409628 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.409744 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.409863 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.409961 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410049 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410236 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410330 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410520 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410615 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410615 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410771 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410850 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410850 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.410994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411067 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411151 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411294 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411377 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411552 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411645 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411645 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.411816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.412446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.412446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.412446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.412446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.412446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.412446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.412446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.413566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.414993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415519 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415519 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415519 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415519 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415519 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.415907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.416362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.416362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.416650 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.416963 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.417273 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.417607 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.417983 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.418120 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419078 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419194 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419272 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419442 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419514 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419594 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419666 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419750 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419822 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.419900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.420102 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.420203 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.420433 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.420542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.420759 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.420852 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.421111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.421221 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.421427 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.421532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.421750 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.421891 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.422090 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.422196 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.422411 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.422522 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.422715 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.422806 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.423026 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.423129 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.423358 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.423455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.423692 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.423785 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.423996 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.424333 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.424653 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.424994 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.425118 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.425303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.426085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.426182 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.426427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.426522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.426756 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.426898 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.427094 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.427232 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.427414 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.427575 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.427727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.427938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.428038 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.428261 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.428362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.428617 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.428717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.428963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.429064 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.429308 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.429400 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.429628 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.429730 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.429972 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.430082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.430310 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.430407 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.430626 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.430738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.430943 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.431043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.431212 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 08:39:03.431315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.431561 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.431890 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.432186 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.432506 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.433342 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.433342 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.433518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.433774 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.434317 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.434641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.435077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.435410 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.435719 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.436030 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.436351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.436670 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.436978 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.437319 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.437635 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.437986 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.438301 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.438613 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.438925 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.439243 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.439561 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.439875 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.440210 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.440558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.440846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.441827 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.442122 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.442556 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.442881 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.443204 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.443544 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.443872 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.444311 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.444641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.445078 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.445497 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.445848 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.446152 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.446465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.446778 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.447088 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.447401 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.447729 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.448043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.448362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.448677 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.448990 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.450164 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.450164 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.450351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.450682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.451325 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.451672 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.451940 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.452301 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.452569 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.453762 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.453762 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.453762 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.454521 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.454521 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.454984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.455238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_db.sqlalchemy.engines [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:03.455451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.455778 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.455887 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.456365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.456485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.457621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.457962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.458192 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.458536 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.458838 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.459158 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.459480 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.459800 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.460123 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.460920 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.460920 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.461119 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.461408 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.461683 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.462031 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.462354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.462671 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.463077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.463389 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.463643 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.463963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.464277 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.464748 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.465071 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.466897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.466897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.466897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.466897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.467231 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.467231 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.467690 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.468328 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.468328 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.468957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.469319 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.469644 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.469990 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.470667 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.470817 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.471107 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.471442 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.471757 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.472072 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.472548 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.473628 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.474365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.475057 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.475730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.476194 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.476645 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.477254 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.477723 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.478439 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.478676 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.479149 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.479849 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.480416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.481096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.481423 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.481973 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.482486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.482980 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.483313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.483752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.484092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.484515 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.484900 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.485240 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.485680 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.486059 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.486375 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.486712 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.487049 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.487362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.487677 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.488524 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.488844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.489150 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.489482 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.489817 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.490134 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.490453 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.490768 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.491078 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.491390 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.491719 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.492030 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.492386 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.492851 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.493040 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.493371 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.493690 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.494064 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.494383 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.494756 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.495137 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.496854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.496854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.496854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.496854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.496854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.497241 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.497513 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.497919 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.498240 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.498552 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.498899 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.499215 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.499527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.499839 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.500156 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.500467 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.500779 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.501090 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.501406 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.501716 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.502068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.502380 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.502709 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.503020 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.503348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.503728 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.504061 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.504351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.505193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.505544 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.505885 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.506232 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.506564 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.506896 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.507232 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.507548 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.507878 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.508203 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.508536 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.508846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.509169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.509482 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.509815 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.510140 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.510458 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.510780 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.511097 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.511421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.511989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.512322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.512640 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.512959 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.513278 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.513604 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.513959 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.514541 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.514857 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.515175 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.515491 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.515824 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.516155 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.516484 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.516825 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.517150 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.517472 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.517804 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.518135 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.518499 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.518819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.519171 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.519854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.520873 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.521254 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.521590 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.521953 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.522289 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.522619 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.522946 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.523271 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.523603 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.523929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.524265 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.524608 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.524939 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.525267 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.525589 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.525942 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.526526 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.526852 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.527197 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.527533 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.528567 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.528907 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.529241 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.529582 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.529926 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.530246 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.530569 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.530891 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.531205 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.531541 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.531861 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.532177 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.532508 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.532827 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.533419 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.533778 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.534130 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.534468 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.534838 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.535184 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.535818 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.535997 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.536318 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.536638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.536965 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.537288 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.537602 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.537941 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.538264 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.538955 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.538955 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.539319 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.539504 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.539841 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.540156 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.540519 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.540779 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.541094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.541406 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.541718 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.542058 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.542370 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.542558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.context [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53658e27-76fc-4752-a30c-0afc17fb2e9d(cell1) {{(pid=132797) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 08:39:03.542705 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.542985 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.543305 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.543618 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.543934 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.544249 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.544567 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.544879 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.545211 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.545523 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.545871 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.546203 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.546522 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.546851 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.547007 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:03.547154 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.547474 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.547828 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.548150 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.548592 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:03.548729 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.549092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.549417 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.549551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:03.549768 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.550163 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.551017 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.551708 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.551843 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.552049 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:03.552187 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.552411 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.552732 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.553050 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.553368 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.553688 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.554045 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.554364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.554682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.555238 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.555383 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.555664 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.555988 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.556312 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.556634 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.556953 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.557272 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.557620 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.558115 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.558262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.558569 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.558962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.559187 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.559634 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.559935 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.560261 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.560586 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.560902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.561228 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.561555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.561893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.562222 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.562539 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.562758 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_db.sqlalchemy.engines [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:03.562898 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.563207 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.563538 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.564004 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.564184 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.567421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.567421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.567421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.567421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.567421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.567421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.567421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.567421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.568416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.568416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.568416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.568765 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_db.sqlalchemy.engines [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:03.568900 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.568900 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.569389 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.569516 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.569779 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.570163 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.570481 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.570752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.571063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.571399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.571793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.572049 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.572379 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.572703 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.573034 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.573359 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.573677 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.574043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.574364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.574688 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.575006 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.575325 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.575647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.575969 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.576301 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.576631 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.577056 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.577290 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.577981 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.578632 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.579146 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.579624 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:03.579978 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 08:39:03.608472 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_db.sqlalchemy.engines [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132796) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:03.693227 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.context [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53658e27-76fc-4752-a30c-0afc17fb2e9d(cell1) {{(pid=132796) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 08:39:03.697673 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:03.699320 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:03.700118 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:03.702085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:03.714252 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_db.sqlalchemy.engines [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132796) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:03.715134 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_db.sqlalchemy.engines [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132796) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:03.860323 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_db.sqlalchemy.engines [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:04.012546 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_db.sqlalchemy.engines [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132796) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:04.208694 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: WARNING keystonemiddleware.auth_token [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:39:04.216144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: WARNING keystonemiddleware.auth_token [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:39:04.380158 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: WARNING keystonemiddleware.auth_token [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:39:04.387313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: WARNING keystonemiddleware.auth_token [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:39:04.578766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: WARNING keystonemiddleware.auth_token [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:39:04.584948 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: WARNING keystonemiddleware.auth_token [None req-97a73fce-545d-49d8-aa46-ba12a6e8c9ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:39:04.590609 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ff9bb39c0 pid: 132797 (default app) Oct 28 08:39:04.792647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: WARNING keystonemiddleware.auth_token [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:39:04.798020 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: WARNING keystonemiddleware.auth_token [None req-22f0af35-3aae-46dd-8c5e-de44e111ff8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:39:04.803234 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ff9bb39c0 pid: 132796 (default app) Oct 28 08:39:39.907878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2ab4782a-8241-4c39-a3f9-a7ea3f4e6415 tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] Action: 'create', calling method: .version_select at 0x7f9e79f4ff70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-163716867", "metadata": {"Type": "work"}}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:40.340626 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-48a94a1e-d520-492d-9d2a-97753eca9fd0 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Action: 'create', calling method: .version_select at 0x7f9e79f4df70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-775026258"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:42.603465 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2ab4782a-8241-4c39-a3f9-a7ea3f4e6415 tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.027551 Oct 28 08:39:42.609874 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 1/1] 10.222.0.74 () {60 vars in 1155 bytes} [Thu Oct 28 08:39:38 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 4035 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 08:39:42.922094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-48a94a1e-d520-492d-9d2a-97753eca9fd0 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.778491 Oct 28 08:39:42.923177 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 1/2] 10.222.0.74 () {60 vars in 1154 bytes} [Thu Oct 28 08:39:39 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3782 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 28 08:39:42.928699 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1d7e98c2-34fe-4d7e-9493-7d38fb702c55 tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] Calling method '.version_select at 0x7f9e79e2baf0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:43.051610 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-370090898", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "networks": [{"uuid": "3dbcd9fe-b3e4-459f-83f0-abf0cbb13a6b"}]}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:43.136532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1d7e98c2-34fe-4d7e-9493-7d38fb702c55 tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88" status: 200 len: 352 microversion: 2.1 time: 0.211961 Oct 28 08:39:43.137116 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 2/3] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:42 2021] GET /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88 => generated 352 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:43.142226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5e5435a6-216a-494d-b1ea-7cbaac68bedc tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79e2be50>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:43.267844 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.network.neutron [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] validate_networks() for [('3dbcd9fe-b3e4-459f-83f0-abf0cbb13a6b', None, None, None, None, None)] {{(pid=132797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:39:43.587354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5e5435a6-216a-494d-b1ea-7cbaac68bedc tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0" status: 200 len: 344 microversion: 2.1 time: 0.448753 Oct 28 08:39:43.588346 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 3/4] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:43 2021] GET /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0 => generated 344 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:44.150275 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a5e95de6-46e3-4e3c-89d1-4196c6ac75b1 tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] Calling method '.version_select at 0x7f9e79e3d4c0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:44.239321 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a5e95de6-46e3-4e3c-89d1-4196c6ac75b1 tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88" status: 200 len: 353 microversion: 2.1 time: 0.092822 Oct 28 08:39:44.240175 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 4/5] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:44 2021] GET /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:44.257848 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-86a1b983-32e8-4513-afc0-db849d279f09 tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] Calling method '.version_select at 0x7f9e79e3ddc0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:44.324487 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-86a1b983-32e8-4513-afc0-db849d279f09 tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88" status: 200 len: 353 microversion: 2.1 time: 0.075107 Oct 28 08:39:44.334770 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 5/6] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:44 2021] GET /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:44.339382 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7d7e01a9-7cf7-448d-8b67-c66e5e1cb873 tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] Calling method '.version_select at 0x7f9e79e3df70>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:44.399162 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Flavor limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:39:44.399776 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Image limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:39:44.400020 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Flavor pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:39:44.400593 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Image pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:39:44.401160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:39:44.425671 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:44.430300 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:44.431700 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:44.432493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:44.485427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7d7e01a9-7cf7-448d-8b67-c66e5e1cb873 tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88" status: 202 len: 0 microversion: 2.1 time: 0.149522 Oct 28 08:39:44.486101 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 6/7] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Oct 28 08:39:44 2021] DELETE /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:39:44.497204 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3b3ac4c9-fc5c-43ca-a133-67da203d3a9a tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] Calling method '.version_select at 0x7f9e79e3d9d0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:44.499968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Getting quotas for project bb79404f2ff94257ba8afa55e780804b. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:39:44.510405 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Getting quotas for user 9e9e05166f7d465b87e180ba53fbd5db and project bb79404f2ff94257ba8afa55e780804b. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:39:44.560946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Going to run 1 instances... {{(pid=132797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:39:44.576438 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:39:44.654706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3b3ac4c9-fc5c-43ca-a133-67da203d3a9a tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88" status: 200 len: 352 microversion: 2.1 time: 0.162989 Oct 28 08:39:44.656804 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 7/8] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:44 2021] GET /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88 => generated 352 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:44.662678 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-faac42c9-f154-4e07-b47c-a38b4096fa40 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79e2bb80>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:44.787317 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-faac42c9-f154-4e07-b47c-a38b4096fa40 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0" status: 200 len: 345 microversion: 2.1 time: 0.129164 Oct 28 08:39:44.788653 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 8/9] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:44 2021] GET /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0 => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:44.806993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a2656b1f-df24-47f5-92cd-e5f03c000464 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Action: 'create', calling method: .version_select at 0x7f9e79e2bd30>, body: {"snapshot": {"volume_id": "29dfad54-634a-424b-bc15-58e6dfe447f0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-238947165"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:44.865149 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-79c31826-b76a-4802-a959-35f78f248423 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252235 Oct 28 08:39:44.865808 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 2/10] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:39:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:39:44.878571 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e264577c-1fdd-4232-b02c-29dd5dd33c34 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:44.880233 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e264577c-1fdd-4232-b02c-29dd5dd33c34 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:45.205771 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e264577c-1fdd-4232-b02c-29dd5dd33c34 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:45.251140 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e264577c-1fdd-4232-b02c-29dd5dd33c34 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1214 microversion: 2.1 time: 0.370720 Oct 28 08:39:45.252230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 3/11] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:44 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1214 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:39:45.258346 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a2656b1f-df24-47f5-92cd-e5f03c000464 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.453334 Oct 28 08:39:45.263887 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 9/12] 10.222.0.74 () {60 vars in 1161 bytes} [Thu Oct 28 08:39:44 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:39:45.277231 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9eae83bb-77f4-423f-b2f5-4bbc483bb7b6 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e78ce6ca0>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:45.423077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9eae83bb-77f4-423f-b2f5-4bbc483bb7b6 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe" status: 200 len: 286 microversion: 2.1 time: 0.150011 Oct 28 08:39:45.424101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 4/13] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:45 2021] GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe => generated 286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:45.434532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ce3acd18-71f7-4838-a892-302251e10020 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79e3d820>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:45.678689 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3b681650-3d02-4cc7-9704-84597383de7c tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] Calling method '.version_select at 0x7f9e78cf9e50>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:45.714774 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ce3acd18-71f7-4838-a892-302251e10020 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.283745 Oct 28 08:39:45.716148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 10/14] 10.222.0.74 () {58 vars in 1139 bytes} [Thu Oct 28 08:39:45 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:45.729396 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4c85ca72-7917-4b7b-b247-e08b3e4c1da9 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79dcf820>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:46.014869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-3b681650-3d02-4cc7-9704-84597383de7c tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] HTTP exception thrown: Volume c9dd119d-0445-41dc-98d2-a35095c2db88 could not be found. Oct 28 08:39:46.017034 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3b681650-3d02-4cc7-9704-84597383de7c tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] Returning 404 to user: Volume c9dd119d-0445-41dc-98d2-a35095c2db88 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:46.017968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3b681650-3d02-4cc7-9704-84597383de7c tempest-VolumesGetTestJSON-115692121 tempest-VolumesGetTestJSON-115692121-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88" status: 404 len: 109 microversion: 2.1 time: 0.348006 Oct 28 08:39:46.022900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 5/15] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:45 2021] GET /compute/v2.1/os-volumes/c9dd119d-0445-41dc-98d2-a35095c2db88 => generated 109 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:39:46.115243 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4c85ca72-7917-4b7b-b247-e08b3e4c1da9 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe" status: 200 len: 286 microversion: 2.1 time: 0.392160 Oct 28 08:39:46.119069 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 11/16] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:45 2021] GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe => generated 286 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:46.271985 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3a98d5e6-0e67-417b-9118-141235de72f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:46.272601 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3a98d5e6-0e67-417b-9118-141235de72f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:46.468984 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3a98d5e6-0e67-417b-9118-141235de72f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:46.486300 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3a98d5e6-0e67-417b-9118-141235de72f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1214 microversion: 2.1 time: 0.216652 Oct 28 08:39:46.490299 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 6/17] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:46 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:47.129632 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fb0c9c62-05c5-4fff-8a6c-4e9307c4aa9a tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79dcfca0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:47.234637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fb0c9c62-05c5-4fff-8a6c-4e9307c4aa9a tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe" status: 200 len: 286 microversion: 2.1 time: 0.111393 Oct 28 08:39:47.235756 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 12/18] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:47 2021] GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:47.508628 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-86497d8c-d63b-41a6-8c64-9c07170fde81 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:47.509238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-86497d8c-d63b-41a6-8c64-9c07170fde81 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:47.520655 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-86497d8c-d63b-41a6-8c64-9c07170fde81 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:47.521139 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-86497d8c-d63b-41a6-8c64-9c07170fde81 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:47.522033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-86497d8c-d63b-41a6-8c64-9c07170fde81 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:47.537613 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-86497d8c-d63b-41a6-8c64-9c07170fde81 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:47.956571 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-86497d8c-d63b-41a6-8c64-9c07170fde81 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:47.993881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-86497d8c-d63b-41a6-8c64-9c07170fde81 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1218 microversion: 2.1 time: 0.493185 Oct 28 08:39:48.000175 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 7/19] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:47 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1218 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:48.250160 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d407234a-be11-499c-adb8-e4c60efd9408 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79dcf160>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:48.322070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d407234a-be11-499c-adb8-e4c60efd9408 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe" status: 200 len: 286 microversion: 2.1 time: 0.079450 Oct 28 08:39:48.326056 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 13/20] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:48 2021] GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:49.016579 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dee26d34-cc05-48a5-afce-53b471f49ec5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:49.018458 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dee26d34-cc05-48a5-afce-53b471f49ec5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:49.027115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dee26d34-cc05-48a5-afce-53b471f49ec5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:49.028164 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dee26d34-cc05-48a5-afce-53b471f49ec5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:49.029184 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dee26d34-cc05-48a5-afce-53b471f49ec5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:49.029987 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dee26d34-cc05-48a5-afce-53b471f49ec5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:49.188272 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dee26d34-cc05-48a5-afce-53b471f49ec5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:49.197210 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dee26d34-cc05-48a5-afce-53b471f49ec5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1218 microversion: 2.1 time: 0.184632 Oct 28 08:39:49.207172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 8/21] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:49 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:49.334360 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bb676b4b-6a73-4742-bc81-6088d221aa47 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79e3d9d0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:49.402805 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bb676b4b-6a73-4742-bc81-6088d221aa47 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe" status: 200 len: 286 microversion: 2.1 time: 0.073151 Oct 28 08:39:49.403496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 14/22] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:49 2021] GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:49.672421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6ba8774f-0543-4bba-ae74-8c4a569a1856 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'create', calling method: .version_select at 0x7f9e78cf9dc0>, body: {"keypair": {"name": "tempest-keypair-2061175081"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:49.774906 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-6ba8774f-0543-4bba-ae74-8c4a569a1856 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for project deb9a75c575b487eb97a2f189099cb83. Resources: {'key_pairs'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:39:49.780617 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-6ba8774f-0543-4bba-ae74-8c4a569a1856 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for user 779e2e826df7468d9a84e8f401693d3f and project deb9a75c575b487eb97a2f189099cb83. Resources: {'key_pairs'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:39:49.984416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f0cdbcbb-11c4-41cb-a21a-b2a54d2be718 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Action: 'create', calling method: .version_select at 0x7f9e79dcfd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-295625328", "metadata": {"Type": "work"}}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:49.986679 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f0cdbcbb-11c4-41cb-a21a-b2a54d2be718 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:49.987503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f0cdbcbb-11c4-41cb-a21a-b2a54d2be718 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.110430 Oct 28 08:39:49.992783 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 15/23] 10.222.0.74 () {60 vars in 1155 bytes} [Thu Oct 28 08:39:49 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:39:49.997866 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e68ef123-b8a7-41e1-b195-4cef8c7f2f0d tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Action: 'create', calling method: .version_select at 0x7f9e79e3d280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2101790492", "metadata": {"Type": "work"}}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:49.999255 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e68ef123-b8a7-41e1-b195-4cef8c7f2f0d tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:50.000247 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e68ef123-b8a7-41e1-b195-4cef8c7f2f0d tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006262 Oct 28 08:39:50.000941 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 16/24] 10.222.0.74 () {60 vars in 1155 bytes} [Thu Oct 28 08:39:49 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:39:50.011382 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bc386b22-a415-4984-8039-78a47739efd4 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Action: 'create', calling method: .version_select at 0x7f9e79dcf040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-606521750", "metadata": {"Type": "work"}}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:50.012990 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bc386b22-a415-4984-8039-78a47739efd4 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:50.014561 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bc386b22-a415-4984-8039-78a47739efd4 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007533 Oct 28 08:39:50.021427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 17/25] 10.222.0.74 () {60 vars in 1155 bytes} [Thu Oct 28 08:39:50 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:39:50.045234 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4a5b69f1-3111-4df8-ad6b-7ed4f74cff38 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Calling method '.version_select at 0x7f9e79e2bc10>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:50.114948 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-4a5b69f1-3111-4df8-ad6b-7ed4f74cff38 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] HTTP exception thrown: Volume tempest-invalid-559608244 could not be found. Oct 28 08:39:50.115923 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4a5b69f1-3111-4df8-ad6b-7ed4f74cff38 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Returning 404 to user: Volume tempest-invalid-559608244 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:50.116934 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4a5b69f1-3111-4df8-ad6b-7ed4f74cff38 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/tempest-invalid-559608244" status: 404 len: 98 microversion: 2.1 time: 0.092161 Oct 28 08:39:50.123861 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 18/26] 10.222.0.74 () {58 vars in 1214 bytes} [Thu Oct 28 08:39:50 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-559608244 => generated 98 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 08:39:50.129816 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9ed0edc4-49b2-41a0-9898-b2978574f310 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003692 Oct 28 08:39:50.135153 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 19/27] 10.222.0.74 () {58 vars in 1139 bytes} [Thu Oct 28 08:39:50 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 08:39:50.140083 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5d2386e8-e2ac-4041-83c4-d83cfe792a43 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003669 Oct 28 08:39:50.145686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 20/28] 10.222.0.74 () {58 vars in 1136 bytes} [Thu Oct 28 08:39:50 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 08:39:50.152638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-90447621-4f16-4f77-b1d4-9290295de619 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Calling method '.version_select at 0x7f9e79dcfdc0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:50.245969 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-90447621-4f16-4f77-b1d4-9290295de619 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] HTTP exception thrown: Volume c821d77e-c433-4a20-b091-284267fe5e7d could not be found. Oct 28 08:39:50.246644 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-90447621-4f16-4f77-b1d4-9290295de619 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Returning 404 to user: Volume c821d77e-c433-4a20-b091-284267fe5e7d could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:50.247614 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-90447621-4f16-4f77-b1d4-9290295de619 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/c821d77e-c433-4a20-b091-284267fe5e7d" status: 404 len: 109 microversion: 2.1 time: 0.100566 Oct 28 08:39:50.248478 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 21/29] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Oct 28 08:39:50 2021] DELETE /compute/v2.1/os-volumes/c821d77e-c433-4a20-b091-284267fe5e7d => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:39:50.260043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ff395047-3ef6-48a8-9fa5-f8527b0939ff tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:50.260860 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ff395047-3ef6-48a8-9fa5-f8527b0939ff tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:50.303839 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ff395047-3ef6-48a8-9fa5-f8527b0939ff tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:50.304285 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ff395047-3ef6-48a8-9fa5-f8527b0939ff tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:50.305070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ff395047-3ef6-48a8-9fa5-f8527b0939ff tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:50.305498 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ff395047-3ef6-48a8-9fa5-f8527b0939ff tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:50.319069 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-6ba8774f-0543-4bba-ae74-8c4a569a1856 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for project deb9a75c575b487eb97a2f189099cb83. Resources: {'key_pairs'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:39:50.366753 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-6ba8774f-0543-4bba-ae74-8c4a569a1856 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for user 779e2e826df7468d9a84e8f401693d3f and project deb9a75c575b487eb97a2f189099cb83. Resources: {'key_pairs'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:39:50.382627 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6ba8774f-0543-4bba-ae74-8c4a569a1856 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.019263 Oct 28 08:39:50.383955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 9/30] 10.222.0.74 () {60 vars in 1157 bytes} [Thu Oct 28 08:39:49 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:50.389315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-50b37de0-a914-4c11-95ea-e9b75d3cd063 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Calling method '.version_select at 0x7f9e78c824c0>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:50.439267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-50b37de0-a914-4c11-95ea-e9b75d3cd063 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] HTTP exception thrown: Volume 34191f95-024a-4da4-b920-3a1dc9af5422 could not be found. Oct 28 08:39:50.440061 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-50b37de0-a914-4c11-95ea-e9b75d3cd063 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] Returning 404 to user: Volume 34191f95-024a-4da4-b920-3a1dc9af5422 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:50.441149 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-50b37de0-a914-4c11-95ea-e9b75d3cd063 tempest-VolumesNegativeTest-1092740519 tempest-VolumesNegativeTest-1092740519-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/34191f95-024a-4da4-b920-3a1dc9af5422" status: 404 len: 109 microversion: 2.1 time: 0.055915 Oct 28 08:39:50.447073 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 10/31] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:50 2021] GET /compute/v2.1/os-volumes/34191f95-024a-4da4-b920-3a1dc9af5422 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:39:50.470849 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-36450ff6-ad67-49d4-a563-fb1c8c2968e7 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e78bee940>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:50.528967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-36450ff6-ad67-49d4-a563-fb1c8c2968e7 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe" status: 200 len: 286 microversion: 2.1 time: 0.078146 Oct 28 08:39:50.528967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 11/32] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:50 2021] GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:50.913231 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ff395047-3ef6-48a8-9fa5-f8527b0939ff tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:50.986296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ff395047-3ef6-48a8-9fa5-f8527b0939ff tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1210 microversion: 2.1 time: 0.729882 Oct 28 08:39:50.998878 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 22/33] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:50 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1210 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:51.539616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e6afa02b-0583-4c65-984c-498134137d17 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e78beef70>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:51.604660 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e6afa02b-0583-4c65-984c-498134137d17 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe" status: 200 len: 287 microversion: 2.1 time: 0.070197 Oct 28 08:39:51.616884 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 12/34] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:51 2021] GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:51.626472 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-15bb9982-2505-48cb-914a-59d7186e260a tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79eaaaf0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:51.798863 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-15bb9982-2505-48cb-914a-59d7186e260a tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "DELETE /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe" status: 202 len: 0 microversion: 2.1 time: 0.179414 Oct 28 08:39:51.800050 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 23/35] 10.222.0.74 () {58 vars in 1253 bytes} [Thu Oct 28 08:39:51 2021] DELETE /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:39:51.809011 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1f7f2e48-c99f-4271-ad99-43537125a0e6 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e78bee040>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:51.907893 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1f7f2e48-c99f-4271-ad99-43537125a0e6 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe" status: 200 len: 286 microversion: 2.1 time: 0.103574 Oct 28 08:39:51.909191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 13/36] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:51 2021] GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:52.009851 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9a31a25d-1d48-4bf4-8669-049cccd0ac7a tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:52.011813 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9a31a25d-1d48-4bf4-8669-049cccd0ac7a tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:52.026855 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a31a25d-1d48-4bf4-8669-049cccd0ac7a tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:52.029340 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a31a25d-1d48-4bf4-8669-049cccd0ac7a tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:52.030429 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a31a25d-1d48-4bf4-8669-049cccd0ac7a tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:52.031827 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a31a25d-1d48-4bf4-8669-049cccd0ac7a tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:52.200921 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9a31a25d-1d48-4bf4-8669-049cccd0ac7a tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:52.218512 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9a31a25d-1d48-4bf4-8669-049cccd0ac7a tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1272 microversion: 2.1 time: 0.215900 Oct 28 08:39:52.219800 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 24/37] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:51 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:52.468818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-488455587", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ff72cbf-ad46-4828-989e-fa971038eaa3"}]}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:52.611069 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.network.neutron [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] validate_networks() for [('0ff72cbf-ad46-4828-989e-fa971038eaa3', None, None, None, None, None)] {{(pid=132797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:39:52.937169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d685a61a-0593-48eb-ad84-63a5240b24b3 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79d66700>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:52.995330 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-d685a61a-0593-48eb-ad84-63a5240b24b3 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] HTTP exception thrown: Snapshot 19c0a9b9-88df-45f7-a4ab-19a771b56fbe could not be found. Oct 28 08:39:52.997483 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d685a61a-0593-48eb-ad84-63a5240b24b3 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Returning 404 to user: Snapshot 19c0a9b9-88df-45f7-a4ab-19a771b56fbe could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:52.999121 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d685a61a-0593-48eb-ad84-63a5240b24b3 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe" status: 404 len: 111 microversion: 2.1 time: 0.080763 Oct 28 08:39:53.000508 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 25/38] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:52 2021] GET /compute/v2.1/os-snapshots/19c0a9b9-88df-45f7-a4ab-19a771b56fbe => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:39:53.009468 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8226d5f1-27e6-40f5-9ea1-028aa80e6205 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79e2bee0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:53.399952 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8226d5f1-27e6-40f5-9ea1-028aa80e6205 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0" status: 202 len: 0 microversion: 2.1 time: 0.394469 Oct 28 08:39:53.404300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 26/39] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Oct 28 08:39:53 2021] DELETE /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:39:53.409523 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-50f4f08e-2bf9-41e2-9286-bbf7f91b1ee4 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:53.410563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-50f4f08e-2bf9-41e2-9286-bbf7f91b1ee4 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:53.433390 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50f4f08e-2bf9-41e2-9286-bbf7f91b1ee4 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:53.438438 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50f4f08e-2bf9-41e2-9286-bbf7f91b1ee4 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:53.443327 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50f4f08e-2bf9-41e2-9286-bbf7f91b1ee4 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:53.445182 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50f4f08e-2bf9-41e2-9286-bbf7f91b1ee4 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:53.754727 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-50f4f08e-2bf9-41e2-9286-bbf7f91b1ee4 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:53.769946 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-50f4f08e-2bf9-41e2-9286-bbf7f91b1ee4 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1272 microversion: 2.1 time: 0.363081 Oct 28 08:39:53.772967 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 27/40] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:53 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1272 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:53.793437 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-234def23-9190-4b97-b0b0-56217763d22a tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79ccf670>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:53.869485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-234def23-9190-4b97-b0b0-56217763d22a tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] HTTP exception thrown: Volume 29dfad54-634a-424b-bc15-58e6dfe447f0 could not be found. Oct 28 08:39:53.871155 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-234def23-9190-4b97-b0b0-56217763d22a tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Returning 404 to user: Volume 29dfad54-634a-424b-bc15-58e6dfe447f0 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:53.872140 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-234def23-9190-4b97-b0b0-56217763d22a tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0" status: 404 len: 109 microversion: 2.1 time: 0.097446 Oct 28 08:39:53.872997 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 28/41] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:53 2021] GET /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:39:53.883480 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1cef6570-bd00-42c7-918a-80d99903d381 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79d41280>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:53.963116 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-1cef6570-bd00-42c7-918a-80d99903d381 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] HTTP exception thrown: Volume 29dfad54-634a-424b-bc15-58e6dfe447f0 could not be found. Oct 28 08:39:53.963933 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1cef6570-bd00-42c7-918a-80d99903d381 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Returning 404 to user: Volume 29dfad54-634a-424b-bc15-58e6dfe447f0 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:53.964910 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1cef6570-bd00-42c7-918a-80d99903d381 tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0" status: 404 len: 109 microversion: 2.1 time: 0.086219 Oct 28 08:39:53.968988 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 29/42] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Oct 28 08:39:53 2021] DELETE /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:39:53.975250 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ade75dc9-9de5-4cf1-9d18-97e1193d348c tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Calling method '.version_select at 0x7f9e79ccff70>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:54.062653 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-ade75dc9-9de5-4cf1-9d18-97e1193d348c tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] HTTP exception thrown: Volume 29dfad54-634a-424b-bc15-58e6dfe447f0 could not be found. Oct 28 08:39:54.063714 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ade75dc9-9de5-4cf1-9d18-97e1193d348c tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] Returning 404 to user: Volume 29dfad54-634a-424b-bc15-58e6dfe447f0 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:39:54.064906 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ade75dc9-9de5-4cf1-9d18-97e1193d348c tempest-VolumesSnapshotsTestJSON-1082633739 tempest-VolumesSnapshotsTestJSON-1082633739-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0" status: 404 len: 109 microversion: 2.1 time: 0.094486 Oct 28 08:39:54.066055 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 30/43] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:53 2021] GET /compute/v2.1/os-volumes/29dfad54-634a-424b-bc15-58e6dfe447f0 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:39:54.326475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Flavor limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:39:54.327711 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Image limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:39:54.328653 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Flavor pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:39:54.329362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Image pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:39:54.330037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:39:54.347751 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:54.353442 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:54.372577 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:54.374507 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:54.424726 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Getting quotas for project 2e86d34d96c64ad4a33efd5f4918dc05. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:39:54.434317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Getting quotas for user 805e3067a6734b72acaea745888b8c66 and project 2e86d34d96c64ad4a33efd5f4918dc05. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:39:54.491797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Going to run 1 instances... {{(pid=132797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:39:54.503704 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:39:54.671900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bb6f1af9-12f8-4b65-947c-b6b80538fa70 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.470617 Oct 28 08:39:54.677305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 14/44] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:39:52 2021] POST /compute/v2.1/servers => generated 383 bytes in 2485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:39:54.689994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f0681c8f-75c0-4f98-ab29-093d7a0ff96d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:54.690771 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f0681c8f-75c0-4f98-ab29-093d7a0ff96d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:54.792791 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-65cd6da2-3bde-4456-848b-62d378fb5fcd tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:54.793606 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-65cd6da2-3bde-4456-848b-62d378fb5fcd tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:54.814842 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-65cd6da2-3bde-4456-848b-62d378fb5fcd tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:54.815568 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-65cd6da2-3bde-4456-848b-62d378fb5fcd tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:54.827645 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-65cd6da2-3bde-4456-848b-62d378fb5fcd tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:54.828220 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-65cd6da2-3bde-4456-848b-62d378fb5fcd tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:55.142075 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f0681c8f-75c0-4f98-ab29-093d7a0ff96d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:55.186043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f0681c8f-75c0-4f98-ab29-093d7a0ff96d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1221 microversion: 2.1 time: 0.501184 Oct 28 08:39:55.196121 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 31/45] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:54 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1221 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:55.888447 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1764149", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ff72cbf-ad46-4828-989e-fa971038eaa3"}]}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:55.979029 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-65cd6da2-3bde-4456-848b-62d378fb5fcd tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:55.987638 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-65cd6da2-3bde-4456-848b-62d378fb5fcd tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 1.199236 Oct 28 08:39:55.988761 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 15/46] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:54 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:56.222362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] validate_networks() for [('0ff72cbf-ad46-4828-989e-fa971038eaa3', None, None, None, None, None)] {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:39:57.006298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2588b291-ceed-4570-830d-e9709c117c97 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:57.007579 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2588b291-ceed-4570-830d-e9709c117c97 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:57.024115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2588b291-ceed-4570-830d-e9709c117c97 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:57.026195 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2588b291-ceed-4570-830d-e9709c117c97 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:57.027537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2588b291-ceed-4570-830d-e9709c117c97 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:57.029643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2588b291-ceed-4570-830d-e9709c117c97 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:58.185569 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2588b291-ceed-4570-830d-e9709c117c97 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:58.203607 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2588b291-ceed-4570-830d-e9709c117c97 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 1.199662 Oct 28 08:39:58.216204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 16/47] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:56 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:58.657081 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-901422016", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8054d646-b889-4c53-8d8e-0b66f004b73f"}], "security_groups": [{"name": "tempest-securitygroup--2089238869"}], "key_name": "tempest-keypair-2061175081", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:58.959893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:39:58.960388 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:39:58.960790 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:39:58.961199 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:39:58.961607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:39:58.992211 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:58.994907 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:58.996679 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:58.999547 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:59.050385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.network.neutron [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] validate_networks() for [('8054d646-b889-4c53-8d8e-0b66f004b73f', None, None, None, None, None)] {{(pid=132797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:39:59.078139 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Getting quotas for project 2e86d34d96c64ad4a33efd5f4918dc05. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:39:59.093598 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Getting quotas for user 805e3067a6734b72acaea745888b8c66 and project 2e86d34d96c64ad4a33efd5f4918dc05. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:39:59.119674 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:39:59.133944 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:39:59.442399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-961a414e-8830-4607-962a-0a62bafac1c2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.567495 Oct 28 08:39:59.448054 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 32/48] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:39:55 2021] POST /compute/v2.1/servers => generated 383 bytes in 3574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 08:39:59.468295 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2f3be889-6e05-48d6-9463-32cd1135ba2c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:59.470038 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2f3be889-6e05-48d6-9463-32cd1135ba2c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:59.497142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f3be889-6e05-48d6-9463-32cd1135ba2c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:59.497584 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f3be889-6e05-48d6-9463-32cd1135ba2c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:59.500160 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f3be889-6e05-48d6-9463-32cd1135ba2c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:59.500612 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f3be889-6e05-48d6-9463-32cd1135ba2c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:00.051103 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2f3be889-6e05-48d6-9463-32cd1135ba2c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:00.064304 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2f3be889-6e05-48d6-9463-32cd1135ba2c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.615001 Oct 28 08:40:00.065989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 33/49] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:59 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:00.071774 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3b5e4c0a-3c8c-4bc9-b378-cbd65fbef905 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:00.083005 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3b5e4c0a-3c8c-4bc9-b378-cbd65fbef905 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:00.155466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Flavor limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:40:00.155981 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Image limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:40:00.156552 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Flavor pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:40:00.156953 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Image pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:40:00.157354 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:40:00.183428 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:00.184482 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:00.194919 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:00.196407 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:00.226287 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3b5e4c0a-3c8c-4bc9-b378-cbd65fbef905 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:00.234375 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3b5e4c0a-3c8c-4bc9-b378-cbd65fbef905 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1219 microversion: 2.1 time: 0.165983 Oct 28 08:40:00.244987 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for project deb9a75c575b487eb97a2f189099cb83. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:00.248102 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 34/50] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:00 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1219 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:00.250603 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for user 779e2e826df7468d9a84e8f401693d3f and project deb9a75c575b487eb97a2f189099cb83. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:00.299114 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Going to run 1 instances... {{(pid=132797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:40:00.323629 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:40:00.398310 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-979d8963-045c-4b90-a3af-1a7623876075 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.745364 Oct 28 08:40:00.404696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 17/51] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:39:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:40:00.409297 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e0196228-9cec-4c2b-8896-f3332944b9c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:00.410053 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e0196228-9cec-4c2b-8896-f3332944b9c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:00.534739 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e0196228-9cec-4c2b-8896-f3332944b9c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:00.562391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e0196228-9cec-4c2b-8896-f3332944b9c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1237 microversion: 2.1 time: 0.156506 Oct 28 08:40:00.572886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 35/52] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:00 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1237 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:01.084848 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-56355686-6a4b-41ea-b440-fb70226bce63 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:01.085494 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-56355686-6a4b-41ea-b440-fb70226bce63 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:01.093509 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-56355686-6a4b-41ea-b440-fb70226bce63 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:01.119055 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-56355686-6a4b-41ea-b440-fb70226bce63 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:01.123286 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-56355686-6a4b-41ea-b440-fb70226bce63 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:01.126350 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-56355686-6a4b-41ea-b440-fb70226bce63 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:01.253059 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7aedebd4-ca76-425d-b395-07a583c62937 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:01.253864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7aedebd4-ca76-425d-b395-07a583c62937 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:01.272824 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7aedebd4-ca76-425d-b395-07a583c62937 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:01.279647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7aedebd4-ca76-425d-b395-07a583c62937 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:01.285708 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7aedebd4-ca76-425d-b395-07a583c62937 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:01.293950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7aedebd4-ca76-425d-b395-07a583c62937 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:01.516386 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7aedebd4-ca76-425d-b395-07a583c62937 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:01.531176 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7aedebd4-ca76-425d-b395-07a583c62937 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1223 microversion: 2.1 time: 0.280639 Oct 28 08:40:01.532494 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 36/53] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:01 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1223 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:01.580021 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-10fc0a60-5c7b-4c12-b590-1385a4c4e1f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:01.583680 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-10fc0a60-5c7b-4c12-b590-1385a4c4e1f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:01.594863 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-10fc0a60-5c7b-4c12-b590-1385a4c4e1f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:01.595371 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-10fc0a60-5c7b-4c12-b590-1385a4c4e1f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:01.597318 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-10fc0a60-5c7b-4c12-b590-1385a4c4e1f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:01.600792 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-10fc0a60-5c7b-4c12-b590-1385a4c4e1f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:01.665268 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-56355686-6a4b-41ea-b440-fb70226bce63 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:01.686125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-56355686-6a4b-41ea-b440-fb70226bce63 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.606104 Oct 28 08:40:01.687094 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 18/54] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:01 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:01.805873 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-10fc0a60-5c7b-4c12-b590-1385a4c4e1f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:01.815924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-10fc0a60-5c7b-4c12-b590-1385a4c4e1f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1241 microversion: 2.1 time: 0.239588 Oct 28 08:40:01.819370 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 37/55] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:01 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1241 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:02.506416 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-11d35c4b-40c5-4129-b4b9-80f4c5e4641f tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e78cf9dc0>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:02.558588 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-61ca6f68-e5d4-4976-af3c-b4de142db670 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:02.559346 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-61ca6f68-e5d4-4976-af3c-b4de142db670 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:02.602148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-61ca6f68-e5d4-4976-af3c-b4de142db670 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:02.602609 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-61ca6f68-e5d4-4976-af3c-b4de142db670 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:02.603445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-61ca6f68-e5d4-4976-af3c-b4de142db670 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:02.603958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-61ca6f68-e5d4-4976-af3c-b4de142db670 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:02.676684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-11d35c4b-40c5-4129-b4b9-80f4c5e4641f tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7b6916a7-75c2-4d27-8bb5-ea07e4bbfe19" status: 200 len: 349 microversion: 2.1 time: 0.181053 Oct 28 08:40:02.677698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 19/56] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:40:02 2021] GET /compute/v2.1/os-volumes/7b6916a7-75c2-4d27-8bb5-ea07e4bbfe19 => generated 349 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:02.704410 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3e5444a5-5324-43ed-8679-1898fea3b720 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:02.705157 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3e5444a5-5324-43ed-8679-1898fea3b720 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:02.718643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e5444a5-5324-43ed-8679-1898fea3b720 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:02.719094 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e5444a5-5324-43ed-8679-1898fea3b720 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:02.719891 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e5444a5-5324-43ed-8679-1898fea3b720 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:02.720323 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e5444a5-5324-43ed-8679-1898fea3b720 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:02.881518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-61ca6f68-e5d4-4976-af3c-b4de142db670 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:02.898575 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-61ca6f68-e5d4-4976-af3c-b4de142db670 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1223 microversion: 2.1 time: 0.342866 Oct 28 08:40:02.899506 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 38/57] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:02 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1223 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:02.927518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1b07cab4-9b3b-4f65-9000-763d1ad8b19d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:02.928209 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1b07cab4-9b3b-4f65-9000-763d1ad8b19d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:02.948126 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1b07cab4-9b3b-4f65-9000-763d1ad8b19d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:02.948502 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1b07cab4-9b3b-4f65-9000-763d1ad8b19d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:02.953055 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1b07cab4-9b3b-4f65-9000-763d1ad8b19d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:02.953528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1b07cab4-9b3b-4f65-9000-763d1ad8b19d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:03.171244 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1b07cab4-9b3b-4f65-9000-763d1ad8b19d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:03.190892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1b07cab4-9b3b-4f65-9000-763d1ad8b19d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1241 microversion: 2.1 time: 0.280061 Oct 28 08:40:03.195703 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 39/58] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:02 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1241 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:03.270204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3e5444a5-5324-43ed-8679-1898fea3b720 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:03.279808 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3e5444a5-5324-43ed-8679-1898fea3b720 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.578908 Oct 28 08:40:03.292030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 20/59] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:02 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:03.924526 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-deab7a1d-8ec2-418b-bf03-7baaa2af39e2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:03.925474 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-deab7a1d-8ec2-418b-bf03-7baaa2af39e2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:03.931889 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-deab7a1d-8ec2-418b-bf03-7baaa2af39e2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:03.932349 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-deab7a1d-8ec2-418b-bf03-7baaa2af39e2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:03.933430 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-deab7a1d-8ec2-418b-bf03-7baaa2af39e2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:03.933895 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-deab7a1d-8ec2-418b-bf03-7baaa2af39e2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:04.052666 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-deab7a1d-8ec2-418b-bf03-7baaa2af39e2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:04.069065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-deab7a1d-8ec2-418b-bf03-7baaa2af39e2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1223 microversion: 2.1 time: 0.149173 Oct 28 08:40:04.087020 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 40/60] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:03 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1223 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:04.209155 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-72486cbd-629f-4bf5-a45b-266a63841736 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:04.212620 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-72486cbd-629f-4bf5-a45b-266a63841736 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:04.221081 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-72486cbd-629f-4bf5-a45b-266a63841736 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:04.222052 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-72486cbd-629f-4bf5-a45b-266a63841736 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:04.223319 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-72486cbd-629f-4bf5-a45b-266a63841736 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:04.224190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-72486cbd-629f-4bf5-a45b-266a63841736 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:04.297229 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2c0e0ad9-bcf4-4a4c-888b-d965a946c5d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:04.298450 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2c0e0ad9-bcf4-4a4c-888b-d965a946c5d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:04.308293 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c0e0ad9-bcf4-4a4c-888b-d965a946c5d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:04.310024 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c0e0ad9-bcf4-4a4c-888b-d965a946c5d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:04.313417 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c0e0ad9-bcf4-4a4c-888b-d965a946c5d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:04.314192 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c0e0ad9-bcf4-4a4c-888b-d965a946c5d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:04.346434 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-72486cbd-629f-4bf5-a45b-266a63841736 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:04.356087 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-72486cbd-629f-4bf5-a45b-266a63841736 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1241 microversion: 2.1 time: 0.150855 Oct 28 08:40:04.367279 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 21/61] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:04 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:04.568351 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f94f7728-d96b-419f-9a5f-107e804a5200 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e783a2ca0>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:04.571555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2c0e0ad9-bcf4-4a4c-888b-d965a946c5d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:04.580776 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2c0e0ad9-bcf4-4a4c-888b-d965a946c5d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.287375 Oct 28 08:40:04.581671 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 41/62] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:04 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:04.641981 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f94f7728-d96b-419f-9a5f-107e804a5200 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/686a0851-846e-47d8-875b-18436459d619" status: 200 len: 351 microversion: 2.1 time: 0.068191 Oct 28 08:40:04.642793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 22/63] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:40:04 2021] GET /compute/v2.1/os-volumes/686a0851-846e-47d8-875b-18436459d619 => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:40:05.086793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8c9ab163-d3bf-4ad3-9cbe-29986fe13bcd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:05.088090 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8c9ab163-d3bf-4ad3-9cbe-29986fe13bcd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:05.110566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8c9ab163-d3bf-4ad3-9cbe-29986fe13bcd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:05.117138 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8c9ab163-d3bf-4ad3-9cbe-29986fe13bcd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:05.118365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8c9ab163-d3bf-4ad3-9cbe-29986fe13bcd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:05.119973 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8c9ab163-d3bf-4ad3-9cbe-29986fe13bcd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:05.263027 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8c9ab163-d3bf-4ad3-9cbe-29986fe13bcd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:05.277316 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8c9ab163-d3bf-4ad3-9cbe-29986fe13bcd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1223 microversion: 2.1 time: 0.195163 Oct 28 08:40:05.279003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 42/64] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:05 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1223 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:05.373949 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3e9ac2a1-aac1-40bd-8ee4-c7b5e66e3d68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:05.375305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3e9ac2a1-aac1-40bd-8ee4-c7b5e66e3d68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:05.389826 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e9ac2a1-aac1-40bd-8ee4-c7b5e66e3d68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:05.397475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e9ac2a1-aac1-40bd-8ee4-c7b5e66e3d68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:05.398922 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e9ac2a1-aac1-40bd-8ee4-c7b5e66e3d68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:05.404142 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e9ac2a1-aac1-40bd-8ee4-c7b5e66e3d68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:05.516107 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3e9ac2a1-aac1-40bd-8ee4-c7b5e66e3d68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:05.525131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3e9ac2a1-aac1-40bd-8ee4-c7b5e66e3d68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1241 microversion: 2.1 time: 0.155061 Oct 28 08:40:05.526026 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 23/65] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:05 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:05.601725 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0ceec55b-d976-475d-a978-04173a6912b5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:05.606635 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0ceec55b-d976-475d-a978-04173a6912b5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:05.621798 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ceec55b-d976-475d-a978-04173a6912b5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:05.623270 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ceec55b-d976-475d-a978-04173a6912b5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:05.624635 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ceec55b-d976-475d-a978-04173a6912b5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:05.628219 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ceec55b-d976-475d-a978-04173a6912b5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:05.896794 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0ceec55b-d976-475d-a978-04173a6912b5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:05.906838 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0ceec55b-d976-475d-a978-04173a6912b5 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.311700 Oct 28 08:40:05.908804 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 43/66] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:05 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:06.195922 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2aa65ed2-9e63-4441-a8a4-4fdedca936b2 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e78bee550>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:06.296102 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-05021c61-fe30-4082-a6e5-97dac1a18ce1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:06.297831 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-05021c61-fe30-4082-a6e5-97dac1a18ce1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:06.305836 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2aa65ed2-9e63-4441-a8a4-4fdedca936b2 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/df528c79-1cf2-4b75-ba2c-98cdf2bf18c7" status: 200 len: 351 microversion: 2.1 time: 0.113353 Oct 28 08:40:06.312527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05021c61-fe30-4082-a6e5-97dac1a18ce1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:06.312527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05021c61-fe30-4082-a6e5-97dac1a18ce1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:06.312527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05021c61-fe30-4082-a6e5-97dac1a18ce1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:06.312527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05021c61-fe30-4082-a6e5-97dac1a18ce1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:06.314359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 24/67] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/os-volumes/df528c79-1cf2-4b75-ba2c-98cdf2bf18c7 => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:06.326941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c909f83a-86c0-4a22-9bb2-8b0225168084 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e783a2670>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:06.462128 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-05021c61-fe30-4082-a6e5-97dac1a18ce1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:06.469454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-05021c61-fe30-4082-a6e5-97dac1a18ce1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1223 microversion: 2.1 time: 0.177958 Oct 28 08:40:06.470061 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 44/68] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1223 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:06.495686 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c909f83a-86c0-4a22-9bb2-8b0225168084 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.179818 Oct 28 08:40:06.496887 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 25/69] 10.222.0.74 () {58 vars in 1133 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:06.512859 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-58f48b3d-157f-49bd-a19e-484192a5b392 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e78bd6280>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:06.543663 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4f4e31ea-ce3c-4327-8fa8-8e97c28917f1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:06.544401 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4f4e31ea-ce3c-4327-8fa8-8e97c28917f1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:06.556664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4f4e31ea-ce3c-4327-8fa8-8e97c28917f1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:06.557433 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4f4e31ea-ce3c-4327-8fa8-8e97c28917f1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:06.558320 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4f4e31ea-ce3c-4327-8fa8-8e97c28917f1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:06.558858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4f4e31ea-ce3c-4327-8fa8-8e97c28917f1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:06.716005 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-58f48b3d-157f-49bd-a19e-484192a5b392 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.208192 Oct 28 08:40:06.717919 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 45/70] 10.222.0.74 () {58 vars in 1148 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:06.733755 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e14b83e4-8399-4fd7-9a7c-b45f6dd21422 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e7942a1f0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:06.734954 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-4f4e31ea-ce3c-4327-8fa8-8e97c28917f1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:06.748957 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4f4e31ea-ce3c-4327-8fa8-8e97c28917f1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1241 microversion: 2.1 time: 0.204804 Oct 28 08:40:06.751184 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 26/71] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1241 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:06.924993 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-935aa52f-ed8e-47da-9f05-45086d9abd70 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:06.926594 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-935aa52f-ed8e-47da-9f05-45086d9abd70 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:06.935985 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-935aa52f-ed8e-47da-9f05-45086d9abd70 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:06.937252 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-935aa52f-ed8e-47da-9f05-45086d9abd70 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:06.939141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-935aa52f-ed8e-47da-9f05-45086d9abd70 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:06.940043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-935aa52f-ed8e-47da-9f05-45086d9abd70 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:06.956354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e14b83e4-8399-4fd7-9a7c-b45f6dd21422 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.226819 Oct 28 08:40:06.958056 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 46/72] 10.222.0.74 () {58 vars in 1133 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:06.970866 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-30ac4d20-7b74-40b8-b2d3-9eb407fc7877 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e794403a0>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.191926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-935aa52f-ed8e-47da-9f05-45086d9abd70 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:07.199917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-935aa52f-ed8e-47da-9f05-45086d9abd70 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.279228 Oct 28 08:40:07.201131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 27/73] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:07.260078 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-30ac4d20-7b74-40b8-b2d3-9eb407fc7877 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.293867 Oct 28 08:40:07.261676 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 47/74] 10.222.0.74 () {58 vars in 1166 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:07.275162 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-833ae7ec-4b9a-494a-9427-52365ad76a14 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e78cf9af0>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.450361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-833ae7ec-4b9a-494a-9427-52365ad76a14 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.178569 Oct 28 08:40:07.451243 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 28/75] 10.222.0.74 () {58 vars in 1169 bytes} [Thu Oct 28 08:40:07 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:07.466607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-538b15ab-fd51-43e7-a118-4d3ce4077b77 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e79440e50>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.491275 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0d388c79-62b7-4797-8cbb-797fcabe159b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.491944 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0d388c79-62b7-4797-8cbb-797fcabe159b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:07.498411 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0d388c79-62b7-4797-8cbb-797fcabe159b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:07.499262 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0d388c79-62b7-4797-8cbb-797fcabe159b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:07.499635 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0d388c79-62b7-4797-8cbb-797fcabe159b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:07.500077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0d388c79-62b7-4797-8cbb-797fcabe159b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:07.579830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0d388c79-62b7-4797-8cbb-797fcabe159b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:07.589611 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0d388c79-62b7-4797-8cbb-797fcabe159b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1223 microversion: 2.1 time: 0.102174 Oct 28 08:40:07.590608 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 29/76] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:07 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:07.621924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-538b15ab-fd51-43e7-a118-4d3ce4077b77 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.161307 Oct 28 08:40:07.622796 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 48/77] 10.222.0.74 () {58 vars in 1154 bytes} [Thu Oct 28 08:40:07 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:07.639177 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-be50df56-5c53-4286-b9b2-e448610e7848 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e7838d280>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.771579 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d596bc28-89c1-48dc-97d3-b053993a2342 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.772164 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d596bc28-89c1-48dc-97d3-b053993a2342 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:07.778119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-be50df56-5c53-4286-b9b2-e448610e7848 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.147197 Oct 28 08:40:07.778936 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d596bc28-89c1-48dc-97d3-b053993a2342 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:07.779391 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 30/78] 10.222.0.74 () {58 vars in 1187 bytes} [Thu Oct 28 08:40:07 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:07.786612 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d596bc28-89c1-48dc-97d3-b053993a2342 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:07.787820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d596bc28-89c1-48dc-97d3-b053993a2342 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:07.788270 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d596bc28-89c1-48dc-97d3-b053993a2342 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:07.795032 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-42d5f4ab-a8bb-47db-a5a8-8e4df9b931d1 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] Calling method '.version_select at 0x7f9e783a2280>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.890202 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-42d5f4ab-a8bb-47db-a5a8-8e4df9b931d1 tempest-VolumesTestJSON-1481541247 tempest-VolumesTestJSON-1481541247-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.102096 Oct 28 08:40:07.890864 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 31/79] 10.222.0.74 () {58 vars in 1154 bytes} [Thu Oct 28 08:40:07 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:07.900756 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d596bc28-89c1-48dc-97d3-b053993a2342 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:07.919686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d596bc28-89c1-48dc-97d3-b053993a2342 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1241 microversion: 2.1 time: 0.153627 Oct 28 08:40:07.920702 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 49/80] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:07 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:08.217538 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-515b3c4e-7100-4895-bec1-f9ae609e8829 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:08.218191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-515b3c4e-7100-4895-bec1-f9ae609e8829 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:08.224815 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-515b3c4e-7100-4895-bec1-f9ae609e8829 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:08.225969 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-515b3c4e-7100-4895-bec1-f9ae609e8829 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:08.226802 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-515b3c4e-7100-4895-bec1-f9ae609e8829 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:08.227247 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-515b3c4e-7100-4895-bec1-f9ae609e8829 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:08.386173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-515b3c4e-7100-4895-bec1-f9ae609e8829 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:08.394466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-515b3c4e-7100-4895-bec1-f9ae609e8829 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.180515 Oct 28 08:40:08.395253 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 32/81] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:08 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:08.607390 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4ac8e021-337c-4867-b13c-fce784a2fdd4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:08.608001 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4ac8e021-337c-4867-b13c-fce784a2fdd4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:08.617503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4ac8e021-337c-4867-b13c-fce784a2fdd4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:08.618555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4ac8e021-337c-4867-b13c-fce784a2fdd4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:08.620172 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4ac8e021-337c-4867-b13c-fce784a2fdd4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:08.622285 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4ac8e021-337c-4867-b13c-fce784a2fdd4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:08.755011 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4ac8e021-337c-4867-b13c-fce784a2fdd4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:08.767976 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4ac8e021-337c-4867-b13c-fce784a2fdd4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1223 microversion: 2.1 time: 0.161524 Oct 28 08:40:08.771833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 50/82] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:08 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1223 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:08.938641 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-38a8eea1-dde7-4e3f-a546-e2a072702022 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:08.940506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-38a8eea1-dde7-4e3f-a546-e2a072702022 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:08.955625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-38a8eea1-dde7-4e3f-a546-e2a072702022 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:08.956625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-38a8eea1-dde7-4e3f-a546-e2a072702022 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:08.959700 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-38a8eea1-dde7-4e3f-a546-e2a072702022 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:08.960750 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-38a8eea1-dde7-4e3f-a546-e2a072702022 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:09.141925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-38a8eea1-dde7-4e3f-a546-e2a072702022 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:09.160961 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-38a8eea1-dde7-4e3f-a546-e2a072702022 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1241 microversion: 2.1 time: 0.226862 Oct 28 08:40:09.166091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 33/83] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:08 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1241 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:09.414708 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-54a187b6-0663-49b5-8b4d-4b8969c48329 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:09.416095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-54a187b6-0663-49b5-8b4d-4b8969c48329 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:09.425165 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54a187b6-0663-49b5-8b4d-4b8969c48329 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:09.427652 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54a187b6-0663-49b5-8b4d-4b8969c48329 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:09.428478 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54a187b6-0663-49b5-8b4d-4b8969c48329 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:09.429103 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54a187b6-0663-49b5-8b4d-4b8969c48329 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:09.655341 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-54a187b6-0663-49b5-8b4d-4b8969c48329 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:09.681710 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-54a187b6-0663-49b5-8b4d-4b8969c48329 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.270115 Oct 28 08:40:09.684108 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 51/84] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:09 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:09.787807 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a787075b-e87e-4fd4-93b6-3f0a11c65b56 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:09.788630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a787075b-e87e-4fd4-93b6-3f0a11c65b56 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:09.806319 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a787075b-e87e-4fd4-93b6-3f0a11c65b56 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:09.807137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a787075b-e87e-4fd4-93b6-3f0a11c65b56 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:09.808216 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a787075b-e87e-4fd4-93b6-3f0a11c65b56 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:09.809673 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a787075b-e87e-4fd4-93b6-3f0a11c65b56 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:09.993047 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a787075b-e87e-4fd4-93b6-3f0a11c65b56 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:10.001452 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a787075b-e87e-4fd4-93b6-3f0a11c65b56 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1215 microversion: 2.1 time: 0.217934 Oct 28 08:40:10.004804 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 34/85] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:09 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:10.179383 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b2917d8c-efb2-4159-b56b-2701cd7b5325 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:10.180050 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b2917d8c-efb2-4159-b56b-2701cd7b5325 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:10.194543 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b2917d8c-efb2-4159-b56b-2701cd7b5325 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:10.195217 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b2917d8c-efb2-4159-b56b-2701cd7b5325 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:10.202168 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b2917d8c-efb2-4159-b56b-2701cd7b5325 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:10.202615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b2917d8c-efb2-4159-b56b-2701cd7b5325 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:10.318563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b2917d8c-efb2-4159-b56b-2701cd7b5325 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:10.327169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b2917d8c-efb2-4159-b56b-2701cd7b5325 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1289 microversion: 2.1 time: 0.153177 Oct 28 08:40:10.331179 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 52/86] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:10 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1289 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:10.700315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-085c405c-74c3-4060-8d55-8bbe0d77077e tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:10.702659 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-085c405c-74c3-4060-8d55-8bbe0d77077e tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:10.728451 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-085c405c-74c3-4060-8d55-8bbe0d77077e tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:10.728918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-085c405c-74c3-4060-8d55-8bbe0d77077e tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:10.729712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-085c405c-74c3-4060-8d55-8bbe0d77077e tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:10.736325 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-085c405c-74c3-4060-8d55-8bbe0d77077e tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:11.030975 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e7b54cf5-f03b-498f-b57b-fe7a33561831 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:11.034084 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e7b54cf5-f03b-498f-b57b-fe7a33561831 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:11.050106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7b54cf5-f03b-498f-b57b-fe7a33561831 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:11.051192 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7b54cf5-f03b-498f-b57b-fe7a33561831 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:11.052933 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7b54cf5-f03b-498f-b57b-fe7a33561831 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:11.053705 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7b54cf5-f03b-498f-b57b-fe7a33561831 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:11.310118 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e7b54cf5-f03b-498f-b57b-fe7a33561831 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:11.319423 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e7b54cf5-f03b-498f-b57b-fe7a33561831 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1289 microversion: 2.1 time: 0.300705 Oct 28 08:40:11.320938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 53/87] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:11 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1289 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:11.431868 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-fba5e3be-46d9-401a-a149-501f267591eb req-510f6ca4-65e3-41f7-8213-550ddc9eff77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8affc35a-332d-434c-824c-e1c8719900e7", "tag": "1ea9f506-fc5b-4333-86a8-f36b3750df5b"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:11.434244 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:11.434244 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:40:11.446465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-fba5e3be-46d9-401a-a149-501f267591eb req-510f6ca4-65e3-41f7-8213-550ddc9eff77 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:11.447097 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-fba5e3be-46d9-401a-a149-501f267591eb req-510f6ca4-65e3-41f7-8213-550ddc9eff77 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:11.472340 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-fba5e3be-46d9-401a-a149-501f267591eb req-510f6ca4-65e3-41f7-8213-550ddc9eff77 service nova] Creating event network-changed:1ea9f506-fc5b-4333-86a8-f36b3750df5b for instance 8affc35a-332d-434c-824c-e1c8719900e7 on hv-cinder-81566 Oct 28 08:40:11.473403 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-fba5e3be-46d9-401a-a149-501f267591eb req-510f6ca4-65e3-41f7-8213-550ddc9eff77 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132796) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 08:40:11.474741 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7e74f2d8-15c8-4b32-9ddc-c0fdc1e9d394 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:11.475399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7e74f2d8-15c8-4b32-9ddc-c0fdc1e9d394 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:11.476200 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7e74f2d8-15c8-4b32-9ddc-c0fdc1e9d394 None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:11.476784 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7e74f2d8-15c8-4b32-9ddc-c0fdc1e9d394 None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:11.487130 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.compute.rpcapi [None req-7e74f2d8-15c8-4b32-9ddc-c0fdc1e9d394 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 08:40:11.488342 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7e74f2d8-15c8-4b32-9ddc-c0fdc1e9d394 None None] Releasing lock "compute-rpcapi-router" {{(pid=132796) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 08:40:11.519601 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7e74f2d8-15c8-4b32-9ddc-c0fdc1e9d394 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196740 Oct 28 08:40:11.520763 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 54/88] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:11.526171 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-102f86c3-ba29-4eda-aee1-4f4be3362d50 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:11.527142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-102f86c3-ba29-4eda-aee1-4f4be3362d50 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:11.533836 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-102f86c3-ba29-4eda-aee1-4f4be3362d50 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:11.534361 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-102f86c3-ba29-4eda-aee1-4f4be3362d50 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:11.535684 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-102f86c3-ba29-4eda-aee1-4f4be3362d50 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:11.536266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-102f86c3-ba29-4eda-aee1-4f4be3362d50 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:11.577085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-085c405c-74c3-4060-8d55-8bbe0d77077e tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:11.588742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-085c405c-74c3-4060-8d55-8bbe0d77077e tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.892055 Oct 28 08:40:11.590352 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 35/89] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:10 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:11.655720 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-102f86c3-ba29-4eda-aee1-4f4be3362d50 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:11.672548 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-102f86c3-ba29-4eda-aee1-4f4be3362d50 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1295 microversion: 2.1 time: 0.150294 Oct 28 08:40:11.673509 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 55/90] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:11 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1295 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:12.344434 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6b119c92-a116-49c3-a1f9-6c6445b0e1d0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:12.345656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6b119c92-a116-49c3-a1f9-6c6445b0e1d0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:12.353143 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6b119c92-a116-49c3-a1f9-6c6445b0e1d0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:12.353960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6b119c92-a116-49c3-a1f9-6c6445b0e1d0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:12.354917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6b119c92-a116-49c3-a1f9-6c6445b0e1d0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:12.355590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6b119c92-a116-49c3-a1f9-6c6445b0e1d0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:12.554335 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6b119c92-a116-49c3-a1f9-6c6445b0e1d0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:12.562435 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6b119c92-a116-49c3-a1f9-6c6445b0e1d0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.229286 Oct 28 08:40:12.563083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 36/91] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:12 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:12.610470 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7669d763-0529-4277-801a-7fd3082f28ce tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:12.611290 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7669d763-0529-4277-801a-7fd3082f28ce tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:12.618012 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7669d763-0529-4277-801a-7fd3082f28ce tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:12.618460 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7669d763-0529-4277-801a-7fd3082f28ce tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:12.619413 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7669d763-0529-4277-801a-7fd3082f28ce tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:12.619843 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7669d763-0529-4277-801a-7fd3082f28ce tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:12.694713 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e39947f9-aeeb-4ac6-82e1-bed3b4c04caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:12.695349 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e39947f9-aeeb-4ac6-82e1-bed3b4c04caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:12.702055 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e39947f9-aeeb-4ac6-82e1-bed3b4c04caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:12.702742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e39947f9-aeeb-4ac6-82e1-bed3b4c04caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:12.703720 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e39947f9-aeeb-4ac6-82e1-bed3b4c04caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:12.704162 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e39947f9-aeeb-4ac6-82e1-bed3b4c04caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:12.807377 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7669d763-0529-4277-801a-7fd3082f28ce tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:12.815530 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7669d763-0529-4277-801a-7fd3082f28ce tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.210312 Oct 28 08:40:12.818319 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 56/92] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:12 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:12.896193 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e39947f9-aeeb-4ac6-82e1-bed3b4c04caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:12.903441 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e39947f9-aeeb-4ac6-82e1-bed3b4c04caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.213510 Oct 28 08:40:12.904097 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 37/93] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:12 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:13.580071 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c46a95a5-9cfb-4df5-ba2a-0f9d3f39f5fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:13.580736 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c46a95a5-9cfb-4df5-ba2a-0f9d3f39f5fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:13.587071 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c46a95a5-9cfb-4df5-ba2a-0f9d3f39f5fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:13.587575 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c46a95a5-9cfb-4df5-ba2a-0f9d3f39f5fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:13.588546 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c46a95a5-9cfb-4df5-ba2a-0f9d3f39f5fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:13.588991 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c46a95a5-9cfb-4df5-ba2a-0f9d3f39f5fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:13.728334 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c46a95a5-9cfb-4df5-ba2a-0f9d3f39f5fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:13.735767 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c46a95a5-9cfb-4df5-ba2a-0f9d3f39f5fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.159338 Oct 28 08:40:13.736342 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 57/94] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:13 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:13.832830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1d20deba-db38-4427-9a35-370e60664411 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:13.833456 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1d20deba-db38-4427-9a35-370e60664411 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:13.839578 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1d20deba-db38-4427-9a35-370e60664411 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:13.839959 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1d20deba-db38-4427-9a35-370e60664411 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:13.840742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1d20deba-db38-4427-9a35-370e60664411 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:13.841168 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1d20deba-db38-4427-9a35-370e60664411 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:13.920016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-36e958bf-0bb5-44f9-a66b-8603394f64ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:13.920632 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-36e958bf-0bb5-44f9-a66b-8603394f64ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:13.927428 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36e958bf-0bb5-44f9-a66b-8603394f64ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:13.927871 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36e958bf-0bb5-44f9-a66b-8603394f64ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:13.928826 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36e958bf-0bb5-44f9-a66b-8603394f64ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:13.929413 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36e958bf-0bb5-44f9-a66b-8603394f64ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:13.987898 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-1d20deba-db38-4427-9a35-370e60664411 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:13.997298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1d20deba-db38-4427-9a35-370e60664411 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.168822 Oct 28 08:40:14.008202 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 38/95] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:13 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:14.080471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-36e958bf-0bb5-44f9-a66b-8603394f64ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:14.089553 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-36e958bf-0bb5-44f9-a66b-8603394f64ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.173018 Oct 28 08:40:14.090304 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 58/96] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:13 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:14.762889 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b16bab8b-2e82-417e-8597-8c244ad01316 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:14.764321 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b16bab8b-2e82-417e-8597-8c244ad01316 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:14.771902 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b16bab8b-2e82-417e-8597-8c244ad01316 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:14.772320 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b16bab8b-2e82-417e-8597-8c244ad01316 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:14.773749 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b16bab8b-2e82-417e-8597-8c244ad01316 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:14.774617 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b16bab8b-2e82-417e-8597-8c244ad01316 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:14.911462 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b16bab8b-2e82-417e-8597-8c244ad01316 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:14.919992 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b16bab8b-2e82-417e-8597-8c244ad01316 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.163328 Oct 28 08:40:14.920570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 39/97] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:14 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:15.015003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-de6dc00d-9ae9-4378-95aa-a5a5598ddd03 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:15.015980 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-de6dc00d-9ae9-4378-95aa-a5a5598ddd03 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:15.022569 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de6dc00d-9ae9-4378-95aa-a5a5598ddd03 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:15.023248 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de6dc00d-9ae9-4378-95aa-a5a5598ddd03 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:15.024059 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de6dc00d-9ae9-4378-95aa-a5a5598ddd03 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:15.024645 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de6dc00d-9ae9-4378-95aa-a5a5598ddd03 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:15.106718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a6ce721c-555a-417d-8d78-6813c04717e5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:15.107991 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a6ce721c-555a-417d-8d78-6813c04717e5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:15.121942 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6ce721c-555a-417d-8d78-6813c04717e5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:15.122752 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6ce721c-555a-417d-8d78-6813c04717e5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:15.123985 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6ce721c-555a-417d-8d78-6813c04717e5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:15.124743 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6ce721c-555a-417d-8d78-6813c04717e5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:15.681127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a6ce721c-555a-417d-8d78-6813c04717e5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:15.689657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a6ce721c-555a-417d-8d78-6813c04717e5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.585962 Oct 28 08:40:15.698894 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 40/98] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:15 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:15.712841 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-de6dc00d-9ae9-4378-95aa-a5a5598ddd03 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:15.721913 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-de6dc00d-9ae9-4378-95aa-a5a5598ddd03 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.710231 Oct 28 08:40:15.723585 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 59/99] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:15 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:15.937411 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2dd1b8d2-3321-4dd9-bdf6-7c54fc3b8d67 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:15.937989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2dd1b8d2-3321-4dd9-bdf6-7c54fc3b8d67 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:15.944809 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2dd1b8d2-3321-4dd9-bdf6-7c54fc3b8d67 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:15.945477 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2dd1b8d2-3321-4dd9-bdf6-7c54fc3b8d67 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:15.946257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2dd1b8d2-3321-4dd9-bdf6-7c54fc3b8d67 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:15.946823 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2dd1b8d2-3321-4dd9-bdf6-7c54fc3b8d67 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:16.695923 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-fa23cdde-3a16-4ea4-a18d-4c9183bdb51b req-9410ea69-65eb-45a4-acbe-b04b254c2010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d46e50-0675-4d39-9947-f35acce9f945", "tag": "ca1bece9-ad29-4024-93d9-2e154ebe1e8e"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:16.697623 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:16.697623 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:40:16.717836 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-fa23cdde-3a16-4ea4-a18d-4c9183bdb51b req-9410ea69-65eb-45a4-acbe-b04b254c2010 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:16.720714 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-fa23cdde-3a16-4ea4-a18d-4c9183bdb51b req-9410ea69-65eb-45a4-acbe-b04b254c2010 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:16.749322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-fa23cdde-3a16-4ea4-a18d-4c9183bdb51b req-9410ea69-65eb-45a4-acbe-b04b254c2010 service nova] Creating event network-changed:ca1bece9-ad29-4024-93d9-2e154ebe1e8e for instance a8d46e50-0675-4d39-9947-f35acce9f945 on hv-cinder-81566 Oct 28 08:40:16.773339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-fa23cdde-3a16-4ea4-a18d-4c9183bdb51b req-9410ea69-65eb-45a4-acbe-b04b254c2010 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095968 Oct 28 08:40:16.778477 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 60/100] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:16.810232 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2690b593-7534-420b-b8cc-57f19c3a45e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:16.810923 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2690b593-7534-420b-b8cc-57f19c3a45e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:16.821361 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2690b593-7534-420b-b8cc-57f19c3a45e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:16.822072 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2690b593-7534-420b-b8cc-57f19c3a45e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:16.823738 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2690b593-7534-420b-b8cc-57f19c3a45e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:16.824367 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2690b593-7534-420b-b8cc-57f19c3a45e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:16.941106 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2dd1b8d2-3321-4dd9-bdf6-7c54fc3b8d67 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:16.955505 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2dd1b8d2-3321-4dd9-bdf6-7c54fc3b8d67 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 1.015632 Oct 28 08:40:16.956686 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 41/101] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:15 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:16.968580 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3be28061-1a13-4344-a29d-18ec9e3983d0 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:16.969180 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3be28061-1a13-4344-a29d-18ec9e3983d0 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:16.992193 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3be28061-1a13-4344-a29d-18ec9e3983d0 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:16.992643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3be28061-1a13-4344-a29d-18ec9e3983d0 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:16.993427 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3be28061-1a13-4344-a29d-18ec9e3983d0 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:16.993882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3be28061-1a13-4344-a29d-18ec9e3983d0 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:17.483638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2690b593-7534-420b-b8cc-57f19c3a45e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:17.493178 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2690b593-7534-420b-b8cc-57f19c3a45e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.712814 Oct 28 08:40:17.500845 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 61/102] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:16 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:17.583852 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3be28061-1a13-4344-a29d-18ec9e3983d0 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:17.596842 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3be28061-1a13-4344-a29d-18ec9e3983d0 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.628655 Oct 28 08:40:17.598341 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 42/103] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:16 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:17.973670 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4b7d06e5-7c48-45fd-b194-c7e373ba5fa8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:17.974400 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4b7d06e5-7c48-45fd-b194-c7e373ba5fa8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:17.985422 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b7d06e5-7c48-45fd-b194-c7e373ba5fa8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:17.985898 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b7d06e5-7c48-45fd-b194-c7e373ba5fa8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:17.986740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b7d06e5-7c48-45fd-b194-c7e373ba5fa8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:17.987197 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b7d06e5-7c48-45fd-b194-c7e373ba5fa8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:18.506587 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-b44325b3-809a-4157-82ec-1d02a5afaf06 req-6ec76d23-b88f-4c55-abfe-2fe74495ee16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70c146b-a5ed-43af-aad8-18fb35f2dab5", "tag": "93c85b10-5891-4f31-b058-20a4f4a01304"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:18.514727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:18.514727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:40:18.544203 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-b44325b3-809a-4157-82ec-1d02a5afaf06 req-6ec76d23-b88f-4c55-abfe-2fe74495ee16 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:18.545282 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-b44325b3-809a-4157-82ec-1d02a5afaf06 req-6ec76d23-b88f-4c55-abfe-2fe74495ee16 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:18.547999 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4b7d06e5-7c48-45fd-b194-c7e373ba5fa8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:18.568772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4b7d06e5-7c48-45fd-b194-c7e373ba5fa8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.599775 Oct 28 08:40:18.585859 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 62/104] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:17 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:18.603951 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-935725b9-35d8-49e7-900b-f1390fddec21 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:18.604898 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-935725b9-35d8-49e7-900b-f1390fddec21 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:18.623702 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-b44325b3-809a-4157-82ec-1d02a5afaf06 req-6ec76d23-b88f-4c55-abfe-2fe74495ee16 service nova] Creating event network-changed:93c85b10-5891-4f31-b058-20a4f4a01304 for instance c70c146b-a5ed-43af-aad8-18fb35f2dab5 on hv-cinder-81566 Oct 28 08:40:18.626221 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-b44325b3-809a-4157-82ec-1d02a5afaf06 req-6ec76d23-b88f-4c55-abfe-2fe74495ee16 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 08:40:18.630657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08f0131e-3877-452f-b955-878d54e06e79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:18.631644 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08f0131e-3877-452f-b955-878d54e06e79 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:18.633395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08f0131e-3877-452f-b955-878d54e06e79 None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:18.633829 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-935725b9-35d8-49e7-900b-f1390fddec21 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:18.634566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-935725b9-35d8-49e7-900b-f1390fddec21 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:18.634731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08f0131e-3877-452f-b955-878d54e06e79 None None] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:18.635817 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-935725b9-35d8-49e7-900b-f1390fddec21 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:18.636597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-935725b9-35d8-49e7-900b-f1390fddec21 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:18.653710 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.compute.rpcapi [None req-08f0131e-3877-452f-b955-878d54e06e79 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 08:40:18.655695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08f0131e-3877-452f-b955-878d54e06e79 None None] Releasing lock "compute-rpcapi-router" {{(pid=132797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 08:40:18.721383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-08f0131e-3877-452f-b955-878d54e06e79 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.480686 Oct 28 08:40:18.723522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 43/105] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:40:18.739291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e7ebb182-a34a-4ef5-8752-6deb70e0c857 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:18.740474 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e7ebb182-a34a-4ef5-8752-6deb70e0c857 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:18.751326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e7ebb182-a34a-4ef5-8752-6deb70e0c857 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:18.752438 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e7ebb182-a34a-4ef5-8752-6deb70e0c857 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:18.754190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e7ebb182-a34a-4ef5-8752-6deb70e0c857 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:18.755138 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e7ebb182-a34a-4ef5-8752-6deb70e0c857 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:19.179489 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-935725b9-35d8-49e7-900b-f1390fddec21 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:19.185059 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e7ebb182-a34a-4ef5-8752-6deb70e0c857 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:19.195367 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e7ebb182-a34a-4ef5-8752-6deb70e0c857 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.466908 Oct 28 08:40:19.196208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 44/106] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:18 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:19.210751 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-bb3ca77c-f49b-4fe3-9491-11d52eb7006d req-77fe5987-78a1-4928-b120-ebc0d82901b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f8fde60-8e1e-4fdd-93bb-2731aaa3b816", "tag": "21f88ffd-b1f0-4eee-a795-5feb6bbbdd08"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:19.212451 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:19.212451 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:40:19.218492 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-935725b9-35d8-49e7-900b-f1390fddec21 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.640693 Oct 28 08:40:19.220412 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 63/107] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:18 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:19.235898 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-bb3ca77c-f49b-4fe3-9491-11d52eb7006d req-77fe5987-78a1-4928-b120-ebc0d82901b6 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:19.237387 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-bb3ca77c-f49b-4fe3-9491-11d52eb7006d req-77fe5987-78a1-4928-b120-ebc0d82901b6 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:19.256128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-bb3ca77c-f49b-4fe3-9491-11d52eb7006d req-77fe5987-78a1-4928-b120-ebc0d82901b6 service nova] Creating event network-changed:21f88ffd-b1f0-4eee-a795-5feb6bbbdd08 for instance 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 on hv-cinder-81566 Oct 28 08:40:19.264621 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-bb3ca77c-f49b-4fe3-9491-11d52eb7006d req-77fe5987-78a1-4928-b120-ebc0d82901b6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066381 Oct 28 08:40:19.266223 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 45/108] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:19.607002 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2626a4ca-0cfe-417e-9a84-eab39f1400c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:19.607614 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2626a4ca-0cfe-417e-9a84-eab39f1400c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:19.621739 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2626a4ca-0cfe-417e-9a84-eab39f1400c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:19.622223 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2626a4ca-0cfe-417e-9a84-eab39f1400c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:19.636198 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2626a4ca-0cfe-417e-9a84-eab39f1400c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:19.648449 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2626a4ca-0cfe-417e-9a84-eab39f1400c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.209832 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2626a4ca-0cfe-417e-9a84-eab39f1400c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:20.219195 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c62db69b-4a89-4d93-9b86-db2a210036fa tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:20.220542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c62db69b-4a89-4d93-9b86-db2a210036fa tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:20.236307 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2626a4ca-0cfe-417e-9a84-eab39f1400c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.638220 Oct 28 08:40:20.239268 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 64/109] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:19 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:20.240375 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c62db69b-4a89-4d93-9b86-db2a210036fa tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.241651 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c62db69b-4a89-4d93-9b86-db2a210036fa tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.244805 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c62db69b-4a89-4d93-9b86-db2a210036fa tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.245517 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c62db69b-4a89-4d93-9b86-db2a210036fa tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.251222 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4e9e1b4c-b7fb-48f3-b6a3-3add9e494cbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:20.254878 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4e9e1b4c-b7fb-48f3-b6a3-3add9e494cbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:20.273549 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4e9e1b4c-b7fb-48f3-b6a3-3add9e494cbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.278486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4e9e1b4c-b7fb-48f3-b6a3-3add9e494cbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.283160 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4e9e1b4c-b7fb-48f3-b6a3-3add9e494cbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.283782 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4e9e1b4c-b7fb-48f3-b6a3-3add9e494cbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.707714 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4e9e1b4c-b7fb-48f3-b6a3-3add9e494cbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:20.716878 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4e9e1b4c-b7fb-48f3-b6a3-3add9e494cbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.475376 Oct 28 08:40:20.718081 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 65/110] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:20 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:20.725314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c62db69b-4a89-4d93-9b86-db2a210036fa tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:20.734390 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c62db69b-4a89-4d93-9b86-db2a210036fa tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.520411 Oct 28 08:40:20.735505 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 46/111] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:20 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:21.255837 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-cb8197c4-cbc2-4925-96c6-1b2d656ff64c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:21.257369 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-cb8197c4-cbc2-4925-96c6-1b2d656ff64c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:21.268680 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cb8197c4-cbc2-4925-96c6-1b2d656ff64c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.270931 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cb8197c4-cbc2-4925-96c6-1b2d656ff64c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.272354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cb8197c4-cbc2-4925-96c6-1b2d656ff64c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.272790 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cb8197c4-cbc2-4925-96c6-1b2d656ff64c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.456463 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-cb8197c4-cbc2-4925-96c6-1b2d656ff64c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:21.466621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-cb8197c4-cbc2-4925-96c6-1b2d656ff64c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.215293 Oct 28 08:40:21.474585 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 66/112] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:21 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:21.738520 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-61cca0d9-5c51-47b0-966b-345767804e4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:21.739197 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-61cca0d9-5c51-47b0-966b-345767804e4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:21.748413 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61cca0d9-5c51-47b0-966b-345767804e4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.748867 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61cca0d9-5c51-47b0-966b-345767804e4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.749646 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61cca0d9-5c51-47b0-966b-345767804e4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.755682 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61cca0d9-5c51-47b0-966b-345767804e4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.756875 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-84be9e25-c08b-4cc3-bf90-f8f06fbbc432 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:21.757482 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-84be9e25-c08b-4cc3-bf90-f8f06fbbc432 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:21.766095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-84be9e25-c08b-4cc3-bf90-f8f06fbbc432 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.768622 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-84be9e25-c08b-4cc3-bf90-f8f06fbbc432 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.772494 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-84be9e25-c08b-4cc3-bf90-f8f06fbbc432 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.773257 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-84be9e25-c08b-4cc3-bf90-f8f06fbbc432 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:22.096199 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-61cca0d9-5c51-47b0-966b-345767804e4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:22.104918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-61cca0d9-5c51-47b0-966b-345767804e4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.370456 Oct 28 08:40:22.116664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 47/113] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:21 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:22.143355 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-84be9e25-c08b-4cc3-bf90-f8f06fbbc432 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:22.173331 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-84be9e25-c08b-4cc3-bf90-f8f06fbbc432 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.420767 Oct 28 08:40:22.176225 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 67/114] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:21 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:22.485918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-59b69d68-9aa5-42c2-ad7f-f87f3fdd8753 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:22.486787 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-59b69d68-9aa5-42c2-ad7f-f87f3fdd8753 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:22.497590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-59b69d68-9aa5-42c2-ad7f-f87f3fdd8753 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:22.498325 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-59b69d68-9aa5-42c2-ad7f-f87f3fdd8753 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:22.499273 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-59b69d68-9aa5-42c2-ad7f-f87f3fdd8753 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:22.499894 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-59b69d68-9aa5-42c2-ad7f-f87f3fdd8753 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:22.664586 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-59b69d68-9aa5-42c2-ad7f-f87f3fdd8753 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:22.675110 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-59b69d68-9aa5-42c2-ad7f-f87f3fdd8753 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.193528 Oct 28 08:40:22.682504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 48/115] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:22 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:23.134422 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3bbdb6f1-27be-4684-adaa-fc3bc9fee53f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:23.135806 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3bbdb6f1-27be-4684-adaa-fc3bc9fee53f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:23.145311 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3bbdb6f1-27be-4684-adaa-fc3bc9fee53f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.146334 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3bbdb6f1-27be-4684-adaa-fc3bc9fee53f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.147575 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3bbdb6f1-27be-4684-adaa-fc3bc9fee53f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.148214 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3bbdb6f1-27be-4684-adaa-fc3bc9fee53f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.202090 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5aee0bc4-92d5-42b3-a23f-1647fda7197f tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:23.208394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5aee0bc4-92d5-42b3-a23f-1647fda7197f tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:23.234770 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5aee0bc4-92d5-42b3-a23f-1647fda7197f tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.236238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5aee0bc4-92d5-42b3-a23f-1647fda7197f tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.237338 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5aee0bc4-92d5-42b3-a23f-1647fda7197f tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.237923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5aee0bc4-92d5-42b3-a23f-1647fda7197f tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.456404 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3bbdb6f1-27be-4684-adaa-fc3bc9fee53f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:23.469707 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3bbdb6f1-27be-4684-adaa-fc3bc9fee53f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.340468 Oct 28 08:40:23.470555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 68/116] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:23 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:23.517830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5aee0bc4-92d5-42b3-a23f-1647fda7197f tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:23.529159 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5aee0bc4-92d5-42b3-a23f-1647fda7197f tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.340127 Oct 28 08:40:23.530595 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 49/117] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:23 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:23.700163 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-98e3c111-e288-4e3a-8055-b022984da34c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:23.700792 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-98e3c111-e288-4e3a-8055-b022984da34c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:23.713905 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-98e3c111-e288-4e3a-8055-b022984da34c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.714403 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-98e3c111-e288-4e3a-8055-b022984da34c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.715216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-98e3c111-e288-4e3a-8055-b022984da34c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.715657 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-98e3c111-e288-4e3a-8055-b022984da34c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.946869 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-98e3c111-e288-4e3a-8055-b022984da34c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:23.954619 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-98e3c111-e288-4e3a-8055-b022984da34c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.260044 Oct 28 08:40:23.964935 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 69/118] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:23 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:24.490907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-99646a1d-2f6e-4bb5-94d6-8aa89a33e208 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:24.492130 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-99646a1d-2f6e-4bb5-94d6-8aa89a33e208 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:24.499041 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99646a1d-2f6e-4bb5-94d6-8aa89a33e208 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.500179 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99646a1d-2f6e-4bb5-94d6-8aa89a33e208 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.501196 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99646a1d-2f6e-4bb5-94d6-8aa89a33e208 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.501562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99646a1d-2f6e-4bb5-94d6-8aa89a33e208 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.554761 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0f65698e-241a-4a0b-8a26-d16c92f699c2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:24.555362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0f65698e-241a-4a0b-8a26-d16c92f699c2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:24.574088 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f65698e-241a-4a0b-8a26-d16c92f699c2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.586490 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f65698e-241a-4a0b-8a26-d16c92f699c2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.587591 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f65698e-241a-4a0b-8a26-d16c92f699c2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.588162 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f65698e-241a-4a0b-8a26-d16c92f699c2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.831701 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-99646a1d-2f6e-4bb5-94d6-8aa89a33e208 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:24.843191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-99646a1d-2f6e-4bb5-94d6-8aa89a33e208 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.356924 Oct 28 08:40:24.853846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 50/119] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:24 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:24.869518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0f65698e-241a-4a0b-8a26-d16c92f699c2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:24.877562 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0f65698e-241a-4a0b-8a26-d16c92f699c2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.327750 Oct 28 08:40:24.878738 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 70/120] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:24 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:24.974232 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8bb11133-4256-4100-9364-6447556e2768 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:24.974914 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8bb11133-4256-4100-9364-6447556e2768 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:24.982463 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8bb11133-4256-4100-9364-6447556e2768 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.982911 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8bb11133-4256-4100-9364-6447556e2768 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.983749 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8bb11133-4256-4100-9364-6447556e2768 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.984418 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8bb11133-4256-4100-9364-6447556e2768 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.037542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-09a32fd4-dfe5-42c4-87fe-70fa51a61d07 req-9d9c1730-f218-47f2-8f5b-f50a97b92931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8affc35a-332d-434c-824c-e1c8719900e7", "name": "network-vif-plugged", "status": "completed", "tag": "1ea9f506-fc5b-4333-86a8-f36b3750df5b"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:25.039454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:25.039454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:40:25.061813 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-09a32fd4-dfe5-42c4-87fe-70fa51a61d07 req-9d9c1730-f218-47f2-8f5b-f50a97b92931 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.062266 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-09a32fd4-dfe5-42c4-87fe-70fa51a61d07 req-9d9c1730-f218-47f2-8f5b-f50a97b92931 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.087190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-09a32fd4-dfe5-42c4-87fe-70fa51a61d07 req-9d9c1730-f218-47f2-8f5b-f50a97b92931 service nova] Creating event network-vif-plugged:1ea9f506-fc5b-4333-86a8-f36b3750df5b for instance 8affc35a-332d-434c-824c-e1c8719900e7 on hv-cinder-81566 Oct 28 08:40:25.099003 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-09a32fd4-dfe5-42c4-87fe-70fa51a61d07 req-9d9c1730-f218-47f2-8f5b-f50a97b92931 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243054 Oct 28 08:40:25.099619 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 51/121] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:25.147098 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8bb11133-4256-4100-9364-6447556e2768 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:25.154754 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8bb11133-4256-4100-9364-6447556e2768 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.185750 Oct 28 08:40:25.156258 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 71/122] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:24 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:25.875283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f7569444-9830-481d-9d7c-e6431fdabf7d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:25.875283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f7569444-9830-481d-9d7c-e6431fdabf7d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:25.882311 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7569444-9830-481d-9d7c-e6431fdabf7d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.887194 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7569444-9830-481d-9d7c-e6431fdabf7d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.888030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7569444-9830-481d-9d7c-e6431fdabf7d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.888472 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7569444-9830-481d-9d7c-e6431fdabf7d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.896271 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-75f3d7df-5056-43ff-8ccd-4aa32821ff56 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:25.896944 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-75f3d7df-5056-43ff-8ccd-4aa32821ff56 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:25.908961 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-75f3d7df-5056-43ff-8ccd-4aa32821ff56 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.909414 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-75f3d7df-5056-43ff-8ccd-4aa32821ff56 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.913567 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-75f3d7df-5056-43ff-8ccd-4aa32821ff56 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.914091 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-75f3d7df-5056-43ff-8ccd-4aa32821ff56 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:26.449110 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-75f3d7df-5056-43ff-8ccd-4aa32821ff56 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:26.463900 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-75f3d7df-5056-43ff-8ccd-4aa32821ff56 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.571741 Oct 28 08:40:26.471225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f7569444-9830-481d-9d7c-e6431fdabf7d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:26.473740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 72/123] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:25 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:26.481291 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d7b832d5-4013-436d-a056-a848815dfd9a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:26.482183 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f7569444-9830-481d-9d7c-e6431fdabf7d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.620721 Oct 28 08:40:26.485848 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 52/124] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:25 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:26.498872 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d7b832d5-4013-436d-a056-a848815dfd9a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:26.522198 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7b832d5-4013-436d-a056-a848815dfd9a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:26.523171 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7b832d5-4013-436d-a056-a848815dfd9a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:26.524252 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7b832d5-4013-436d-a056-a848815dfd9a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:26.524945 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7b832d5-4013-436d-a056-a848815dfd9a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:26.753501 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d7b832d5-4013-436d-a056-a848815dfd9a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:26.763098 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d7b832d5-4013-436d-a056-a848815dfd9a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.285465 Oct 28 08:40:26.764566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 73/125] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:26 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:27.120031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-1e933d5e-56a5-48ec-b52a-222a9b3aaa93 req-ebc90bc3-3dd2-4687-92ba-b4391865fc13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70c146b-a5ed-43af-aad8-18fb35f2dab5", "name": "network-vif-plugged", "status": "completed", "tag": "93c85b10-5891-4f31-b058-20a4f4a01304"}, {"server_uuid": "1f8fde60-8e1e-4fdd-93bb-2731aaa3b816", "name": "network-vif-plugged", "status": "completed", "tag": "21f88ffd-b1f0-4eee-a795-5feb6bbbdd08"}, {"server_uuid": "a8d46e50-0675-4d39-9947-f35acce9f945", "name": "network-vif-plugged", "status": "completed", "tag": "ca1bece9-ad29-4024-93d9-2e154ebe1e8e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:27.127283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:27.127283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:40:27.141921 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-1e933d5e-56a5-48ec-b52a-222a9b3aaa93 req-ebc90bc3-3dd2-4687-92ba-b4391865fc13 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.142626 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-1e933d5e-56a5-48ec-b52a-222a9b3aaa93 req-ebc90bc3-3dd2-4687-92ba-b4391865fc13 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.171656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-1e933d5e-56a5-48ec-b52a-222a9b3aaa93 req-ebc90bc3-3dd2-4687-92ba-b4391865fc13 service nova] Creating event network-vif-plugged:93c85b10-5891-4f31-b058-20a4f4a01304 for instance c70c146b-a5ed-43af-aad8-18fb35f2dab5 on hv-cinder-81566 Oct 28 08:40:27.172079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-1e933d5e-56a5-48ec-b52a-222a9b3aaa93 req-ebc90bc3-3dd2-4687-92ba-b4391865fc13 service nova] Creating event network-vif-plugged:21f88ffd-b1f0-4eee-a795-5feb6bbbdd08 for instance 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 on hv-cinder-81566 Oct 28 08:40:27.172575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-1e933d5e-56a5-48ec-b52a-222a9b3aaa93 req-ebc90bc3-3dd2-4687-92ba-b4391865fc13 service nova] Creating event network-vif-plugged:ca1bece9-ad29-4024-93d9-2e154ebe1e8e for instance a8d46e50-0675-4d39-9947-f35acce9f945 on hv-cinder-81566 Oct 28 08:40:27.181201 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-1e933d5e-56a5-48ec-b52a-222a9b3aaa93 req-ebc90bc3-3dd2-4687-92ba-b4391865fc13 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.067314 Oct 28 08:40:27.182487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 53/126] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:27 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:27.531207 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c7ae8f9e-6f44-41c2-90d3-2b490c2c850c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:27.532315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-54279afa-e8f8-4fc6-87e7-323945e13d71 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:27.533298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-54279afa-e8f8-4fc6-87e7-323945e13d71 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:27.537639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c7ae8f9e-6f44-41c2-90d3-2b490c2c850c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:27.570718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-54279afa-e8f8-4fc6-87e7-323945e13d71 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.575869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-54279afa-e8f8-4fc6-87e7-323945e13d71 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.579150 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c7ae8f9e-6f44-41c2-90d3-2b490c2c850c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.579473 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-54279afa-e8f8-4fc6-87e7-323945e13d71 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.580565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-54279afa-e8f8-4fc6-87e7-323945e13d71 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.588588 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c7ae8f9e-6f44-41c2-90d3-2b490c2c850c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.592979 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c7ae8f9e-6f44-41c2-90d3-2b490c2c850c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.593663 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c7ae8f9e-6f44-41c2-90d3-2b490c2c850c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.128558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-54279afa-e8f8-4fc6-87e7-323945e13d71 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:28.132364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c7ae8f9e-6f44-41c2-90d3-2b490c2c850c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:28.136939 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-54279afa-e8f8-4fc6-87e7-323945e13d71 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1314 microversion: 2.1 time: 0.626057 Oct 28 08:40:28.137520 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 54/127] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:27 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:28.141301 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c7ae8f9e-6f44-41c2-90d3-2b490c2c850c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.628645 Oct 28 08:40:28.142368 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 74/128] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:27 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:28.156583 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-69e23c02-cfc8-4bfb-a065-e76ad520ec81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:28.157448 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-69e23c02-cfc8-4bfb-a065-e76ad520ec81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:28.163900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69e23c02-cfc8-4bfb-a065-e76ad520ec81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.164644 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69e23c02-cfc8-4bfb-a065-e76ad520ec81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.165423 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69e23c02-cfc8-4bfb-a065-e76ad520ec81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.166362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69e23c02-cfc8-4bfb-a065-e76ad520ec81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.371742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-69e23c02-cfc8-4bfb-a065-e76ad520ec81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:28.385543 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-69e23c02-cfc8-4bfb-a065-e76ad520ec81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.234544 Oct 28 08:40:28.396299 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 55/129] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:28 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:29.158920 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4b106e4a-42b1-4862-a990-c95bed796c57 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:29.159532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4b106e4a-42b1-4862-a990-c95bed796c57 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:29.159661 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c8a2aa65-f9c8-4799-8d53-253cc0b7c84f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:29.160292 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c8a2aa65-f9c8-4799-8d53-253cc0b7c84f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:29.167389 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c8a2aa65-f9c8-4799-8d53-253cc0b7c84f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.167830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c8a2aa65-f9c8-4799-8d53-253cc0b7c84f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.168602 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c8a2aa65-f9c8-4799-8d53-253cc0b7c84f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.169278 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c8a2aa65-f9c8-4799-8d53-253cc0b7c84f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.179020 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b106e4a-42b1-4862-a990-c95bed796c57 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.179695 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b106e4a-42b1-4862-a990-c95bed796c57 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.180595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b106e4a-42b1-4862-a990-c95bed796c57 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.181265 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b106e4a-42b1-4862-a990-c95bed796c57 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.519740 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c8a2aa65-f9c8-4799-8d53-253cc0b7c84f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:29.527474 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c8a2aa65-f9c8-4799-8d53-253cc0b7c84f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.371502 Oct 28 08:40:29.528378 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 56/130] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:29 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:29.534056 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-70fc6851-e8a0-47db-b2d4-9c96af4dd31a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:29.535659 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-70fc6851-e8a0-47db-b2d4-9c96af4dd31a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:29.544018 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4b106e4a-42b1-4862-a990-c95bed796c57 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:29.553556 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4b106e4a-42b1-4862-a990-c95bed796c57 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1500 microversion: 2.1 time: 0.399274 Oct 28 08:40:29.554682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 75/131] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:29 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1500 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:29.554841 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-70fc6851-e8a0-47db-b2d4-9c96af4dd31a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.555412 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-70fc6851-e8a0-47db-b2d4-9c96af4dd31a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.556328 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-70fc6851-e8a0-47db-b2d4-9c96af4dd31a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.556769 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-70fc6851-e8a0-47db-b2d4-9c96af4dd31a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.749143 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-70fc6851-e8a0-47db-b2d4-9c96af4dd31a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:29.758818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-70fc6851-e8a0-47db-b2d4-9c96af4dd31a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.229114 Oct 28 08:40:29.771532 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 57/132] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:29 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:30.544207 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b617c794-414d-4679-a5d9-8e9d3aa94813 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:30.545040 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b617c794-414d-4679-a5d9-8e9d3aa94813 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:30.551437 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b617c794-414d-4679-a5d9-8e9d3aa94813 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.552106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b617c794-414d-4679-a5d9-8e9d3aa94813 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.554657 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b617c794-414d-4679-a5d9-8e9d3aa94813 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.555319 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b617c794-414d-4679-a5d9-8e9d3aa94813 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.688740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b617c794-414d-4679-a5d9-8e9d3aa94813 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:30.696351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b617c794-414d-4679-a5d9-8e9d3aa94813 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.155702 Oct 28 08:40:30.696930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 76/133] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:30 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:30.778638 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9f9a33d1-46bb-4b6f-84d6-4a1ec5a8f152 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:30.779246 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9f9a33d1-46bb-4b6f-84d6-4a1ec5a8f152 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:30.785064 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9a33d1-46bb-4b6f-84d6-4a1ec5a8f152 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.786168 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9a33d1-46bb-4b6f-84d6-4a1ec5a8f152 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.786967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9a33d1-46bb-4b6f-84d6-4a1ec5a8f152 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.787404 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9a33d1-46bb-4b6f-84d6-4a1ec5a8f152 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.910742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9f9a33d1-46bb-4b6f-84d6-4a1ec5a8f152 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:30.924346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9f9a33d1-46bb-4b6f-84d6-4a1ec5a8f152 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.149318 Oct 28 08:40:30.924935 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 58/134] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:30 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:31.713328 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ca13ed07-a5bc-414a-8410-89e587755f95 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:31.713966 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ca13ed07-a5bc-414a-8410-89e587755f95 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:31.719878 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ca13ed07-a5bc-414a-8410-89e587755f95 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:31.720258 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ca13ed07-a5bc-414a-8410-89e587755f95 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:31.721029 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ca13ed07-a5bc-414a-8410-89e587755f95 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:31.721457 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ca13ed07-a5bc-414a-8410-89e587755f95 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:31.850994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ca13ed07-a5bc-414a-8410-89e587755f95 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:31.858847 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ca13ed07-a5bc-414a-8410-89e587755f95 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.149134 Oct 28 08:40:31.859442 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 77/135] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:31 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:31.941262 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c7b0e994-94d1-4312-94de-3311991050b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:31.942697 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c7b0e994-94d1-4312-94de-3311991050b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:31.948678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7b0e994-94d1-4312-94de-3311991050b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:31.949119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7b0e994-94d1-4312-94de-3311991050b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:31.949908 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7b0e994-94d1-4312-94de-3311991050b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:31.950347 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7b0e994-94d1-4312-94de-3311991050b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.080186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c7b0e994-94d1-4312-94de-3311991050b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:32.087638 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c7b0e994-94d1-4312-94de-3311991050b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.150012 Oct 28 08:40:32.088207 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 59/136] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:31 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:32.875972 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1f5860ca-38bb-4bbf-aae0-9e6e894c3062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:32.876492 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1f5860ca-38bb-4bbf-aae0-9e6e894c3062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:32.883216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f5860ca-38bb-4bbf-aae0-9e6e894c3062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:32.883666 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f5860ca-38bb-4bbf-aae0-9e6e894c3062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.884431 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f5860ca-38bb-4bbf-aae0-9e6e894c3062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:32.884862 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f5860ca-38bb-4bbf-aae0-9e6e894c3062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.006605 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1f5860ca-38bb-4bbf-aae0-9e6e894c3062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:33.013872 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1f5860ca-38bb-4bbf-aae0-9e6e894c3062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.141778 Oct 28 08:40:33.014433 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 78/137] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:32 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:33.104827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ca0c049f-6c84-4dc6-88a5-a3def7ef1a54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:33.105566 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ca0c049f-6c84-4dc6-88a5-a3def7ef1a54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:33.111686 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ca0c049f-6c84-4dc6-88a5-a3def7ef1a54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.112129 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ca0c049f-6c84-4dc6-88a5-a3def7ef1a54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.112905 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ca0c049f-6c84-4dc6-88a5-a3def7ef1a54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.113379 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ca0c049f-6c84-4dc6-88a5-a3def7ef1a54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.245590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ca0c049f-6c84-4dc6-88a5-a3def7ef1a54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:33.253179 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ca0c049f-6c84-4dc6-88a5-a3def7ef1a54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1319 microversion: 2.1 time: 0.152539 Oct 28 08:40:33.254425 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 60/138] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:33 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:34.033632 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ed44748d-190d-4df9-be48-de9444c8a7fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:34.035099 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ed44748d-190d-4df9-be48-de9444c8a7fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:34.043773 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ed44748d-190d-4df9-be48-de9444c8a7fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.044297 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ed44748d-190d-4df9-be48-de9444c8a7fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.045708 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ed44748d-190d-4df9-be48-de9444c8a7fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.046638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ed44748d-190d-4df9-be48-de9444c8a7fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.199598 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ed44748d-190d-4df9-be48-de9444c8a7fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:34.209710 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ed44748d-190d-4df9-be48-de9444c8a7fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1363 microversion: 2.1 time: 0.180887 Oct 28 08:40:34.210323 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 79/139] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:34 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:34.273843 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2c35360a-08cf-465d-a868-a85bfa5aa940 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:34.274968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2c35360a-08cf-465d-a868-a85bfa5aa940 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:34.281548 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c35360a-08cf-465d-a868-a85bfa5aa940 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.282194 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c35360a-08cf-465d-a868-a85bfa5aa940 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.283811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c35360a-08cf-465d-a868-a85bfa5aa940 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.284405 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c35360a-08cf-465d-a868-a85bfa5aa940 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.306764 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c1630ed7-74ce-4b3c-85fc-b9dccbc9edfc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e327f733-6f04-4308-9837-8e36d176b587"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:34.308210 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c1630ed7-74ce-4b3c-85fc-b9dccbc9edfc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:34.315203 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c1630ed7-74ce-4b3c-85fc-b9dccbc9edfc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.315926 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c1630ed7-74ce-4b3c-85fc-b9dccbc9edfc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.317069 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c1630ed7-74ce-4b3c-85fc-b9dccbc9edfc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.320807 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c1630ed7-74ce-4b3c-85fc-b9dccbc9edfc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.472959 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2c35360a-08cf-465d-a868-a85bfa5aa940 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:34.482707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2c35360a-08cf-465d-a868-a85bfa5aa940 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1512 microversion: 2.1 time: 0.215507 Oct 28 08:40:34.483504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 61/140] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:34 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:34.503624 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-675a5845-e734-4b09-8695-b8b8bdfd67d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:34.506618 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-675a5845-e734-4b09-8695-b8b8bdfd67d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:34.513945 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-675a5845-e734-4b09-8695-b8b8bdfd67d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.515132 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-675a5845-e734-4b09-8695-b8b8bdfd67d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.516547 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-675a5845-e734-4b09-8695-b8b8bdfd67d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.517132 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-675a5845-e734-4b09-8695-b8b8bdfd67d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.591267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-675a5845-e734-4b09-8695-b8b8bdfd67d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lazy-loading 'flavor' on Instance uuid 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:40:34.750275 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-675a5845-e734-4b09-8695-b8b8bdfd67d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "POST /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816/action" status: 200 len: 32 microversion: 2.1 time: 0.252646 Oct 28 08:40:34.756022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 62/141] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:34 2021] POST /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:40:34.761179 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-35249b2f-a337-4094-a83e-5f064dea7abe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:34.762042 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-35249b2f-a337-4094-a83e-5f064dea7abe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:34.769307 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35249b2f-a337-4094-a83e-5f064dea7abe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.770969 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35249b2f-a337-4094-a83e-5f064dea7abe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.772131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35249b2f-a337-4094-a83e-5f064dea7abe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.772658 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35249b2f-a337-4094-a83e-5f064dea7abe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.922033 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c1630ed7-74ce-4b3c-85fc-b9dccbc9edfc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "POST /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.618488 Oct 28 08:40:34.922715 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 80/142] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:40:34 2021] POST /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:40:35.078113 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-35249b2f-a337-4094-a83e-5f064dea7abe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:35.091005 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-35249b2f-a337-4094-a83e-5f064dea7abe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.333607 Oct 28 08:40:35.092089 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 63/143] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:34 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:35.228322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-86bab426-16be-4059-9038-2906a9e00538 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:35.229010 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-86bab426-16be-4059-9038-2906a9e00538 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:35.235955 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-86bab426-16be-4059-9038-2906a9e00538 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.236504 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-86bab426-16be-4059-9038-2906a9e00538 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.237308 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-86bab426-16be-4059-9038-2906a9e00538 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.237737 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-86bab426-16be-4059-9038-2906a9e00538 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.393630 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-86bab426-16be-4059-9038-2906a9e00538 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:35.401978 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-86bab426-16be-4059-9038-2906a9e00538 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1549 microversion: 2.1 time: 0.178840 Oct 28 08:40:35.402784 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 81/144] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:35 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1549 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:35.418959 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-36aadb65-24c2-46b5-bbba-bd95f05ae0e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:35.419492 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-36aadb65-24c2-46b5-bbba-bd95f05ae0e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:35.425149 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36aadb65-24c2-46b5-bbba-bd95f05ae0e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.425592 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36aadb65-24c2-46b5-bbba-bd95f05ae0e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.426748 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36aadb65-24c2-46b5-bbba-bd95f05ae0e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.427187 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36aadb65-24c2-46b5-bbba-bd95f05ae0e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.539707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-36aadb65-24c2-46b5-bbba-bd95f05ae0e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124372 Oct 28 08:40:35.540310 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 64/145] 10.222.0.74 () {58 vars in 1274 bytes} [Thu Oct 28 08:40:35 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:35.706413 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-158769395", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "networks": [{"uuid": "99f80582-49be-48b4-8fdc-c145bb74ebac"}]}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:35.764431 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] validate_networks() for [('99f80582-49be-48b4-8fdc-c145bb74ebac', None, None, None, None, None)] {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:40:36.113864 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9bb58d92-7a2b-4312-9736-0a1919252b72 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:36.114698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9bb58d92-7a2b-4312-9736-0a1919252b72 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:36.123905 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9bb58d92-7a2b-4312-9736-0a1919252b72 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.124688 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9bb58d92-7a2b-4312-9736-0a1919252b72 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.126054 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9bb58d92-7a2b-4312-9736-0a1919252b72 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.126711 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9bb58d92-7a2b-4312-9736-0a1919252b72 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.217086 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:40:36.217499 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:40:36.218273 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:40:36.218682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:40:36.219092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:40:36.240814 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.241483 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.242083 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.242481 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.295381 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Getting quotas for project 5d151ada161c47d4ae433054a67cdb95. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:36.313323 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Getting quotas for user 4cde6e14d5b2432a918c5ffd26dc8335 and project 5d151ada161c47d4ae433054a67cdb95. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:36.347303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9bb58d92-7a2b-4312-9736-0a1919252b72 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:36.355522 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:40:36.358070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:40:36.358359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9bb58d92-7a2b-4312-9736-0a1919252b72 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.249631 Oct 28 08:40:36.359565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 65/146] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:36 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:36.442195 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8d0b9730-2056-4539-bafc-95cca839f300 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735304 Oct 28 08:40:36.442195 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 82/147] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:40:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:40:36.450204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a1ca12ee-5d51-40b2-9691-4920ea994437 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:36.450805 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a1ca12ee-5d51-40b2-9691-4920ea994437 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:36.557256 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a1ca12ee-5d51-40b2-9691-4920ea994437 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:36.565941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a1ca12ee-5d51-40b2-9691-4920ea994437 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1218 microversion: 2.1 time: 0.119266 Oct 28 08:40:36.568009 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 66/148] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:36 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:37.274509 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a1b66092-f59e-47ca-8f94-215b022fb171 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:37.275825 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a1b66092-f59e-47ca-8f94-215b022fb171 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:37.277966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-020137b0-1d34-4ce4-acf4-612f1a1227c7 req-72d7873c-7325-4cb0-b155-d62c48dd1c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d46e50-0675-4d39-9947-f35acce9f945", "tag": "ca1bece9-ad29-4024-93d9-2e154ebe1e8e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:37.280180 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:37.280180 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:40:37.291296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a1b66092-f59e-47ca-8f94-215b022fb171 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.292156 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a1b66092-f59e-47ca-8f94-215b022fb171 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.293322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a1b66092-f59e-47ca-8f94-215b022fb171 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.293845 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a1b66092-f59e-47ca-8f94-215b022fb171 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.294344 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-020137b0-1d34-4ce4-acf4-612f1a1227c7 req-72d7873c-7325-4cb0-b155-d62c48dd1c27 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.294797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-020137b0-1d34-4ce4-acf4-612f1a1227c7 req-72d7873c-7325-4cb0-b155-d62c48dd1c27 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.318594 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-020137b0-1d34-4ce4-acf4-612f1a1227c7 req-72d7873c-7325-4cb0-b155-d62c48dd1c27 service nova] Creating event network-changed:ca1bece9-ad29-4024-93d9-2e154ebe1e8e for instance a8d46e50-0675-4d39-9947-f35acce9f945 on hv-cinder-81566 Oct 28 08:40:37.326988 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-020137b0-1d34-4ce4-acf4-612f1a1227c7 req-72d7873c-7325-4cb0-b155-d62c48dd1c27 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052737 Oct 28 08:40:37.328402 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 67/149] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:40:37.377276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9876bd76-d367-45b0-96a0-ca31b09c39f3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:37.378176 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a1b66092-f59e-47ca-8f94-215b022fb171 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 14 microversion: 2.1 time: 0.108814 Oct 28 08:40:37.378717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9876bd76-d367-45b0-96a0-ca31b09c39f3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:37.379942 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 83/150] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:37 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:40:37.398014 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9876bd76-d367-45b0-96a0-ca31b09c39f3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.398898 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9876bd76-d367-45b0-96a0-ca31b09c39f3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.399939 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9876bd76-d367-45b0-96a0-ca31b09c39f3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.400418 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9876bd76-d367-45b0-96a0-ca31b09c39f3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.586002 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-40289388-fd48-4181-8ac1-b746f770ffcf tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:37.587101 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-40289388-fd48-4181-8ac1-b746f770ffcf tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:37.599072 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-40289388-fd48-4181-8ac1-b746f770ffcf tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.602473 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-40289388-fd48-4181-8ac1-b746f770ffcf tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.603555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-40289388-fd48-4181-8ac1-b746f770ffcf tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.605453 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-40289388-fd48-4181-8ac1-b746f770ffcf tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.663754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9876bd76-d367-45b0-96a0-ca31b09c39f3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:37.671923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9876bd76-d367-45b0-96a0-ca31b09c39f3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.299090 Oct 28 08:40:37.673656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 68/151] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:37 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:37.746453 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-40289388-fd48-4181-8ac1-b746f770ffcf tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:37.754601 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-40289388-fd48-4181-8ac1-b746f770ffcf tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1270 microversion: 2.1 time: 0.173573 Oct 28 08:40:37.755960 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 84/152] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:37 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:38.391570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0a40a67a-f230-4d29-b903-56b6dada4294 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:38.393264 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0a40a67a-f230-4d29-b903-56b6dada4294 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:38.414917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0a40a67a-f230-4d29-b903-56b6dada4294 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.420154 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0a40a67a-f230-4d29-b903-56b6dada4294 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.421447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0a40a67a-f230-4d29-b903-56b6dada4294 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.425064 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0a40a67a-f230-4d29-b903-56b6dada4294 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.616142 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0a40a67a-f230-4d29-b903-56b6dada4294 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 14 microversion: 2.1 time: 0.229184 Oct 28 08:40:38.616932 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 69/153] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:38 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:40:38.696242 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-49244db6-49fd-4484-8e5e-df53cce49888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:38.696863 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-49244db6-49fd-4484-8e5e-df53cce49888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:38.706030 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49244db6-49fd-4484-8e5e-df53cce49888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.706480 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49244db6-49fd-4484-8e5e-df53cce49888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.707791 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49244db6-49fd-4484-8e5e-df53cce49888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.712725 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49244db6-49fd-4484-8e5e-df53cce49888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.781040 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b3dff4d2-1f4e-4503-b9ab-15c89fcbc27b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:38.788564 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b3dff4d2-1f4e-4503-b9ab-15c89fcbc27b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:38.801775 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b3dff4d2-1f4e-4503-b9ab-15c89fcbc27b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.802678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b3dff4d2-1f4e-4503-b9ab-15c89fcbc27b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.803745 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b3dff4d2-1f4e-4503-b9ab-15c89fcbc27b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.804392 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b3dff4d2-1f4e-4503-b9ab-15c89fcbc27b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.923824 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b3dff4d2-1f4e-4503-b9ab-15c89fcbc27b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:38.937346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b3dff4d2-1f4e-4503-b9ab-15c89fcbc27b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1276 microversion: 2.1 time: 0.164540 Oct 28 08:40:38.941070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-49244db6-49fd-4484-8e5e-df53cce49888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:38.950504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 70/154] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:38 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:38.953067 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-49244db6-49fd-4484-8e5e-df53cce49888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.263664 Oct 28 08:40:38.958721 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 85/155] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:38 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:39.630535 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-04236804-b2f1-4acf-86d3-fd71d4bafc45 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:39.633923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-04236804-b2f1-4acf-86d3-fd71d4bafc45 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:39.645911 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04236804-b2f1-4acf-86d3-fd71d4bafc45 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.647165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04236804-b2f1-4acf-86d3-fd71d4bafc45 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.650036 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04236804-b2f1-4acf-86d3-fd71d4bafc45 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.651209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04236804-b2f1-4acf-86d3-fd71d4bafc45 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.784917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-04236804-b2f1-4acf-86d3-fd71d4bafc45 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 14 microversion: 2.1 time: 0.160568 Oct 28 08:40:39.787261 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 71/156] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:39 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:40:39.956742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e61241a4-7c6f-4dcf-b79e-f56349fe960a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:39.958209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e61241a4-7c6f-4dcf-b79e-f56349fe960a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:39.963527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-63232ac6-2487-4cd6-b37f-e4cd6e6186ee req-e764c2b1-51e0-4090-a98f-a9e17c8a4e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587", "tag": "67050f04-b58e-4ffc-af8a-21a4e8404719"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:39.965912 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:39.965912 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:40:39.979761 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-63232ac6-2487-4cd6-b37f-e4cd6e6186ee req-e764c2b1-51e0-4090-a98f-a9e17c8a4e05 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.981742 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-63232ac6-2487-4cd6-b37f-e4cd6e6186ee req-e764c2b1-51e0-4090-a98f-a9e17c8a4e05 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.983046 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e61241a4-7c6f-4dcf-b79e-f56349fe960a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.984746 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e61241a4-7c6f-4dcf-b79e-f56349fe960a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.985670 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e61241a4-7c6f-4dcf-b79e-f56349fe960a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.986123 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e61241a4-7c6f-4dcf-b79e-f56349fe960a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.024274 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-63232ac6-2487-4cd6-b37f-e4cd6e6186ee req-e764c2b1-51e0-4090-a98f-a9e17c8a4e05 service nova] Creating event network-changed:67050f04-b58e-4ffc-af8a-21a4e8404719 for instance 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 on hv-cinder-81566 Oct 28 08:40:40.043268 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-63232ac6-2487-4cd6-b37f-e4cd6e6186ee req-e764c2b1-51e0-4090-a98f-a9e17c8a4e05 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092679 Oct 28 08:40:40.045724 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 86/157] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:40:40.055283 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-cb7ca389-45cf-44d7-aa22-ffae57b7eb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:40.055896 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-cb7ca389-45cf-44d7-aa22-ffae57b7eb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:40.076359 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cb7ca389-45cf-44d7-aa22-ffae57b7eb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.077922 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cb7ca389-45cf-44d7-aa22-ffae57b7eb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.080471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cb7ca389-45cf-44d7-aa22-ffae57b7eb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.081559 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cb7ca389-45cf-44d7-aa22-ffae57b7eb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.264742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e61241a4-7c6f-4dcf-b79e-f56349fe960a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:40.283725 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e61241a4-7c6f-4dcf-b79e-f56349fe960a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.330997 Oct 28 08:40:40.284449 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 72/158] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:39 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:40.363686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-cb7ca389-45cf-44d7-aa22-ffae57b7eb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:40.374186 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-cb7ca389-45cf-44d7-aa22-ffae57b7eb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.326764 Oct 28 08:40:40.374858 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 87/159] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:40 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:40.796708 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5c5b089e-0fe2-409b-8f83-aa928e41df20 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:40.797818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5c5b089e-0fe2-409b-8f83-aa928e41df20 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:40.808570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c5b089e-0fe2-409b-8f83-aa928e41df20 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.812531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c5b089e-0fe2-409b-8f83-aa928e41df20 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.813746 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c5b089e-0fe2-409b-8f83-aa928e41df20 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.814927 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c5b089e-0fe2-409b-8f83-aa928e41df20 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.929196 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5c5b089e-0fe2-409b-8f83-aa928e41df20 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 14 microversion: 2.1 time: 0.135899 Oct 28 08:40:40.929903 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 73/160] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:40 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:40:41.301690 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e9b4f4b9-0f9a-4111-bd53-468cbea6f799 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:41.303336 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e9b4f4b9-0f9a-4111-bd53-468cbea6f799 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:41.315686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e9b4f4b9-0f9a-4111-bd53-468cbea6f799 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.316139 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e9b4f4b9-0f9a-4111-bd53-468cbea6f799 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:41.317559 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e9b4f4b9-0f9a-4111-bd53-468cbea6f799 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.318016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e9b4f4b9-0f9a-4111-bd53-468cbea6f799 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:41.390755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1b3cc5b5-5800-43db-ae7a-b7c873620690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:41.391803 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1b3cc5b5-5800-43db-ae7a-b7c873620690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:41.407212 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1b3cc5b5-5800-43db-ae7a-b7c873620690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.407212 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1b3cc5b5-5800-43db-ae7a-b7c873620690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:41.408073 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1b3cc5b5-5800-43db-ae7a-b7c873620690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.408599 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1b3cc5b5-5800-43db-ae7a-b7c873620690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:41.589001 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e9b4f4b9-0f9a-4111-bd53-468cbea6f799 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:41.613216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e9b4f4b9-0f9a-4111-bd53-468cbea6f799 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.312778 Oct 28 08:40:41.630350 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 88/161] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:41 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:41.697068 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-1b3cc5b5-5800-43db-ae7a-b7c873620690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:41.705577 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1b3cc5b5-5800-43db-ae7a-b7c873620690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.318758 Oct 28 08:40:41.706202 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 74/162] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:41 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:41.940425 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4aed58e2-2cbb-4889-9c99-f07f9c3ddc79 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:41.947036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4aed58e2-2cbb-4889-9c99-f07f9c3ddc79 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:41.956380 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4aed58e2-2cbb-4889-9c99-f07f9c3ddc79 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.959585 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4aed58e2-2cbb-4889-9c99-f07f9c3ddc79 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:41.960458 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4aed58e2-2cbb-4889-9c99-f07f9c3ddc79 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.960893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4aed58e2-2cbb-4889-9c99-f07f9c3ddc79 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.081066 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4aed58e2-2cbb-4889-9c99-f07f9c3ddc79 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 14 microversion: 2.1 time: 0.144015 Oct 28 08:40:42.082357 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 89/163] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:41 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:40:42.664716 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-68cef7f9-ad51-4008-98b2-db1ce80135c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:42.667696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-68cef7f9-ad51-4008-98b2-db1ce80135c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:42.699436 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68cef7f9-ad51-4008-98b2-db1ce80135c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.700649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68cef7f9-ad51-4008-98b2-db1ce80135c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.703544 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68cef7f9-ad51-4008-98b2-db1ce80135c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.707116 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68cef7f9-ad51-4008-98b2-db1ce80135c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.729215 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-971b22cf-fb97-4a6f-b0dd-8d700fa4c702 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:42.734782 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-971b22cf-fb97-4a6f-b0dd-8d700fa4c702 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:42.775697 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-971b22cf-fb97-4a6f-b0dd-8d700fa4c702 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.781807 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-971b22cf-fb97-4a6f-b0dd-8d700fa4c702 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.783488 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-971b22cf-fb97-4a6f-b0dd-8d700fa4c702 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.784458 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-971b22cf-fb97-4a6f-b0dd-8d700fa4c702 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.185723 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-971b22cf-fb97-4a6f-b0dd-8d700fa4c702 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:43.188987 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-68cef7f9-ad51-4008-98b2-db1ce80135c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:43.193465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-971b22cf-fb97-4a6f-b0dd-8d700fa4c702 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.471602 Oct 28 08:40:43.197080 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 90/164] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:42 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:43.198756 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-68cef7f9-ad51-4008-98b2-db1ce80135c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.553121 Oct 28 08:40:43.199345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 75/165] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:42 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:43.204086 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c2cd69a9-07a8-4eea-9ca8-2d658c32ba55 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:43.204969 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c2cd69a9-07a8-4eea-9ca8-2d658c32ba55 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:43.218942 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c2cd69a9-07a8-4eea-9ca8-2d658c32ba55 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.219298 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c2cd69a9-07a8-4eea-9ca8-2d658c32ba55 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.220278 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c2cd69a9-07a8-4eea-9ca8-2d658c32ba55 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.221081 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c2cd69a9-07a8-4eea-9ca8-2d658c32ba55 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.367654 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c2cd69a9-07a8-4eea-9ca8-2d658c32ba55 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 14 microversion: 2.1 time: 0.168825 Oct 28 08:40:43.371212 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 91/166] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:43 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:40:44.222201 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7e0ceb2f-b517-4836-bb2a-d220ec2690a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:44.224162 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-751d9c83-dab2-4321-a2d3-8be533aec22d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:44.227972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-751d9c83-dab2-4321-a2d3-8be533aec22d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:44.228393 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7e0ceb2f-b517-4836-bb2a-d220ec2690a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:44.244478 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-751d9c83-dab2-4321-a2d3-8be533aec22d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.246989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7e0ceb2f-b517-4836-bb2a-d220ec2690a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.247684 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7e0ceb2f-b517-4836-bb2a-d220ec2690a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.248159 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-751d9c83-dab2-4321-a2d3-8be533aec22d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.249092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7e0ceb2f-b517-4836-bb2a-d220ec2690a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.250170 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-751d9c83-dab2-4321-a2d3-8be533aec22d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.250823 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7e0ceb2f-b517-4836-bb2a-d220ec2690a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.254021 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-751d9c83-dab2-4321-a2d3-8be533aec22d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.644259 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7e0ceb2f-b517-4836-bb2a-d220ec2690a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:44.648507 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-751d9c83-dab2-4321-a2d3-8be533aec22d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:44.659377 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-751d9c83-dab2-4321-a2d3-8be533aec22d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.450552 Oct 28 08:40:44.669960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 76/167] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:44 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:44.682585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2c3c2411-5e0e-48f6-9f3f-0518009fae63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:44.683920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2c3c2411-5e0e-48f6-9f3f-0518009fae63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:44.686189 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7e0ceb2f-b517-4836-bb2a-d220ec2690a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.466165 Oct 28 08:40:44.699721 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 92/168] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:44 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:44.699836 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c3c2411-5e0e-48f6-9f3f-0518009fae63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.700318 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c3c2411-5e0e-48f6-9f3f-0518009fae63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.702598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c3c2411-5e0e-48f6-9f3f-0518009fae63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.703043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c3c2411-5e0e-48f6-9f3f-0518009fae63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.780267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2c3c2411-5e0e-48f6-9f3f-0518009fae63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 14 microversion: 2.1 time: 0.108223 Oct 28 08:40:44.780912 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 77/169] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:44 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:40:45.266431 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3b39cb18-dbc6-420c-a47d-1f44d225d8bc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:45.267486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3b39cb18-dbc6-420c-a47d-1f44d225d8bc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:45.277231 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3b39cb18-dbc6-420c-a47d-1f44d225d8bc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.277755 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3b39cb18-dbc6-420c-a47d-1f44d225d8bc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.278655 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3b39cb18-dbc6-420c-a47d-1f44d225d8bc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.279427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3b39cb18-dbc6-420c-a47d-1f44d225d8bc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.308730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3b39cb18-dbc6-420c-a47d-1f44d225d8bc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:40:45.427188 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3b39cb18-dbc6-420c-a47d-1f44d225d8bc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "DELETE /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 204 len: 0 microversion: 2.1 time: 0.163006 Oct 28 08:40:45.429878 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 93/170] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:40:45 2021] DELETE /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:40:45.439968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-14029be8-4de6-4e37-b7bd-20468b245d64 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:45.440638 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-14029be8-4de6-4e37-b7bd-20468b245d64 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:45.447958 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14029be8-4de6-4e37-b7bd-20468b245d64 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.448413 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14029be8-4de6-4e37-b7bd-20468b245d64 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.449186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14029be8-4de6-4e37-b7bd-20468b245d64 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.449619 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14029be8-4de6-4e37-b7bd-20468b245d64 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.665127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-14029be8-4de6-4e37-b7bd-20468b245d64 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:45.678646 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d632cbb8-edfb-438f-8209-3f91865d42df tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:45.679672 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d632cbb8-edfb-438f-8209-3f91865d42df tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:45.684789 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-14029be8-4de6-4e37-b7bd-20468b245d64 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1552 microversion: 2.1 time: 0.250703 Oct 28 08:40:45.688035 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 78/171] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:45 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1552 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:45.695121 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d632cbb8-edfb-438f-8209-3f91865d42df tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.696570 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d632cbb8-edfb-438f-8209-3f91865d42df tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.697449 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d632cbb8-edfb-438f-8209-3f91865d42df tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.697988 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d632cbb8-edfb-438f-8209-3f91865d42df tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.706133 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8e134c47-df04-48d4-8607-feb55f46dda9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:45.706749 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8e134c47-df04-48d4-8607-feb55f46dda9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:45.713714 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8e134c47-df04-48d4-8607-feb55f46dda9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.714242 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8e134c47-df04-48d4-8607-feb55f46dda9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.715022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8e134c47-df04-48d4-8607-feb55f46dda9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.715610 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8e134c47-df04-48d4-8607-feb55f46dda9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.906071 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d632cbb8-edfb-438f-8209-3f91865d42df tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:45.909379 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8e134c47-df04-48d4-8607-feb55f46dda9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:45.916235 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d632cbb8-edfb-438f-8209-3f91865d42df tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.242107 Oct 28 08:40:45.917132 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 94/172] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:45 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:45.920735 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8e134c47-df04-48d4-8607-feb55f46dda9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.218436 Oct 28 08:40:45.921307 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 79/173] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:45 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:45.922497 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e3102227-08e2-4c23-a5a2-cda25caeefea tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:45.923597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e3102227-08e2-4c23-a5a2-cda25caeefea tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:45.932924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3102227-08e2-4c23-a5a2-cda25caeefea tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.933682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3102227-08e2-4c23-a5a2-cda25caeefea tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.934638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3102227-08e2-4c23-a5a2-cda25caeefea tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.935238 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3102227-08e2-4c23-a5a2-cda25caeefea tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.010130 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e3102227-08e2-4c23-a5a2-cda25caeefea tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 14 microversion: 2.1 time: 0.091321 Oct 28 08:40:46.010880 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 95/174] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:45 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:40:46.708289 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a041a1aa-53cb-4b1e-990d-42807414a2dc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:46.709481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a041a1aa-53cb-4b1e-990d-42807414a2dc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:46.716446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a041a1aa-53cb-4b1e-990d-42807414a2dc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.716889 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a041a1aa-53cb-4b1e-990d-42807414a2dc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.717765 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a041a1aa-53cb-4b1e-990d-42807414a2dc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.718143 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a041a1aa-53cb-4b1e-990d-42807414a2dc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.845837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a041a1aa-53cb-4b1e-990d-42807414a2dc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:46.853884 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a041a1aa-53cb-4b1e-990d-42807414a2dc tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1552 microversion: 2.1 time: 0.151334 Oct 28 08:40:46.854458 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 80/175] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:46 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:46.933651 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3c40108d-353d-43b3-b67b-b18f5a747f5a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:46.934429 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3c40108d-353d-43b3-b67b-b18f5a747f5a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:46.937809 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-14a225d0-5733-4c76-b46e-2c8ca4ae88f5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:46.938423 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-14a225d0-5733-4c76-b46e-2c8ca4ae88f5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:46.941406 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c40108d-353d-43b3-b67b-b18f5a747f5a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.942511 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c40108d-353d-43b3-b67b-b18f5a747f5a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.943272 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c40108d-353d-43b3-b67b-b18f5a747f5a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.944016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c40108d-353d-43b3-b67b-b18f5a747f5a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.944786 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14a225d0-5733-4c76-b46e-2c8ca4ae88f5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.945235 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14a225d0-5733-4c76-b46e-2c8ca4ae88f5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.946021 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14a225d0-5733-4c76-b46e-2c8ca4ae88f5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.946462 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14a225d0-5733-4c76-b46e-2c8ca4ae88f5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.135068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3c40108d-353d-43b3-b67b-b18f5a747f5a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:47.140400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-14a225d0-5733-4c76-b46e-2c8ca4ae88f5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:47.143189 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3c40108d-353d-43b3-b67b-b18f5a747f5a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.213400 Oct 28 08:40:47.153312 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 96/176] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:46 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:47.153548 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-14a225d0-5733-4c76-b46e-2c8ca4ae88f5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.214100 Oct 28 08:40:47.153773 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d9d7036a-de6f-4cee-b376-5aa5bfa5524f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:47.153773 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d9d7036a-de6f-4cee-b376-5aa5bfa5524f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:47.157623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 81/177] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:46 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:47.157754 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9d7036a-de6f-4cee-b376-5aa5bfa5524f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.158008 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9d7036a-de6f-4cee-b376-5aa5bfa5524f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.159032 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9d7036a-de6f-4cee-b376-5aa5bfa5524f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.159676 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9d7036a-de6f-4cee-b376-5aa5bfa5524f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.252946 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d9d7036a-de6f-4cee-b376-5aa5bfa5524f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 14 microversion: 2.1 time: 0.107129 Oct 28 08:40:47.253497 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 97/178] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:47 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:40:47.875890 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-935ca062-0ef2-4830-8072-203298727f55 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:47.876583 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-935ca062-0ef2-4830-8072-203298727f55 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:47.883284 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-935ca062-0ef2-4830-8072-203298727f55 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.883724 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-935ca062-0ef2-4830-8072-203298727f55 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.884516 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-935ca062-0ef2-4830-8072-203298727f55 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.884944 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-935ca062-0ef2-4830-8072-203298727f55 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.994719 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-9253f147-453d-462c-aecf-5ed9de9f1b9e req-2050e333-09b3-4aa2-b733-4929f9e3d340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587", "name": "network-vif-plugged", "status": "completed", "tag": "67050f04-b58e-4ffc-af8a-21a4e8404719"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:47.996337 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:47.996337 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:40:48.005861 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-9253f147-453d-462c-aecf-5ed9de9f1b9e req-2050e333-09b3-4aa2-b733-4929f9e3d340 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.006348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-9253f147-453d-462c-aecf-5ed9de9f1b9e req-2050e333-09b3-4aa2-b733-4929f9e3d340 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.021508 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-935ca062-0ef2-4830-8072-203298727f55 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:48.025099 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-9253f147-453d-462c-aecf-5ed9de9f1b9e req-2050e333-09b3-4aa2-b733-4929f9e3d340 service nova] Creating event network-vif-plugged:67050f04-b58e-4ffc-af8a-21a4e8404719 for instance 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 on hv-cinder-81566 Oct 28 08:40:48.029439 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-9253f147-453d-462c-aecf-5ed9de9f1b9e req-2050e333-09b3-4aa2-b733-4929f9e3d340 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038629 Oct 28 08:40:48.030127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 98/179] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:48.031333 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-935ca062-0ef2-4830-8072-203298727f55 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1552 microversion: 2.1 time: 0.159277 Oct 28 08:40:48.031902 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 82/180] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:47 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:48.162566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5b9cf8e6-fbce-438c-b59e-2c1a6eb634de tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:48.163248 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5b9cf8e6-fbce-438c-b59e-2c1a6eb634de tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:48.166143 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d69f6828-7e42-427c-97f0-e48370266697 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:48.167093 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d69f6828-7e42-427c-97f0-e48370266697 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:48.170223 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5b9cf8e6-fbce-438c-b59e-2c1a6eb634de tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.170972 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5b9cf8e6-fbce-438c-b59e-2c1a6eb634de tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.171991 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5b9cf8e6-fbce-438c-b59e-2c1a6eb634de tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.172716 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5b9cf8e6-fbce-438c-b59e-2c1a6eb634de tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.174076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d69f6828-7e42-427c-97f0-e48370266697 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.174632 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d69f6828-7e42-427c-97f0-e48370266697 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.175968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d69f6828-7e42-427c-97f0-e48370266697 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.177266 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d69f6828-7e42-427c-97f0-e48370266697 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.396278 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d69f6828-7e42-427c-97f0-e48370266697 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:48.397432 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5b9cf8e6-fbce-438c-b59e-2c1a6eb634de tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:48.409920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d69f6828-7e42-427c-97f0-e48370266697 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.248088 Oct 28 08:40:48.410920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 83/181] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:48 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:48.415286 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5b9cf8e6-fbce-438c-b59e-2c1a6eb634de tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.258046 Oct 28 08:40:48.416580 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 99/182] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:48 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:48.418434 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8f241379-d15f-4e4b-9e06-086560c4bb7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:48.419516 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8f241379-d15f-4e4b-9e06-086560c4bb7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:48.429035 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8f241379-d15f-4e4b-9e06-086560c4bb7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.429908 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8f241379-d15f-4e4b-9e06-086560c4bb7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.431457 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8f241379-d15f-4e4b-9e06-086560c4bb7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.432286 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8f241379-d15f-4e4b-9e06-086560c4bb7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.730413 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1781658021", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "networks": [{"uuid": "8e42fbac-77c0-47d1-ade7-e20b3e0f64ea"}]}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:48.786078 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] validate_networks() for [('8e42fbac-77c0-47d1-ade7-e20b3e0f64ea', None, None, None, None, None)] {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:40:49.172784 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:40:49.173344 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:40:49.173659 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:40:49.174100 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:40:49.174504 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:40:49.183648 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.184090 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.184887 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.185315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.201412 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Getting quotas for project 5524f9a286464e8db7e4cb81c3879647. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:49.205475 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Getting quotas for user be9c2df8ea2c42c3a7e1d313834fc4e9 and project 5524f9a286464e8db7e4cb81c3879647. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:49.218535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:40:49.220883 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:40:49.266095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5bf6ea91-7564-4100-94d7-062ee2f1709d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539193 Oct 28 08:40:49.266733 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 100/183] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:40:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 08:40:49.271965 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-5f689ff2-a249-4a71-b70b-f894ddb404fc req-c4e7283e-7c3b-4c7f-917c-94e70ed641a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8affc35a-332d-434c-824c-e1c8719900e7", "name": "network-vif-deleted", "tag": "1ea9f506-fc5b-4333-86a8-f36b3750df5b"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:49.273819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:49.273819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:40:49.280922 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-5f689ff2-a249-4a71-b70b-f894ddb404fc req-c4e7283e-7c3b-4c7f-917c-94e70ed641a5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.281343 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-5f689ff2-a249-4a71-b70b-f894ddb404fc req-c4e7283e-7c3b-4c7f-917c-94e70ed641a5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.300815 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-5f689ff2-a249-4a71-b70b-f894ddb404fc req-c4e7283e-7c3b-4c7f-917c-94e70ed641a5 service nova] Creating event network-vif-deleted:1ea9f506-fc5b-4333-86a8-f36b3750df5b for instance 8affc35a-332d-434c-824c-e1c8719900e7 on hv-cinder-81566 Oct 28 08:40:49.305856 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-5f689ff2-a249-4a71-b70b-f894ddb404fc req-c4e7283e-7c3b-4c7f-917c-94e70ed641a5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037930 Oct 28 08:40:49.306689 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 101/184] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:49.311409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-12906ef6-ecc2-43ba-aad4-feabad31f783 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:49.312054 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-12906ef6-ecc2-43ba-aad4-feabad31f783 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:49.318580 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12906ef6-ecc2-43ba-aad4-feabad31f783 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.322769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12906ef6-ecc2-43ba-aad4-feabad31f783 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.322769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12906ef6-ecc2-43ba-aad4-feabad31f783 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.322769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12906ef6-ecc2-43ba-aad4-feabad31f783 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.389209 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-12906ef6-ecc2-43ba-aad4-feabad31f783 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.398749 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-12906ef6-ecc2-43ba-aad4-feabad31f783 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1510 microversion: 2.1 time: 0.091062 Oct 28 08:40:49.399283 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 102/185] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:49 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1510 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:49.403904 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a577a54d-1133-4a20-bf6d-c90810fb3664 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:49.404514 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a577a54d-1133-4a20-bf6d-c90810fb3664 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:49.459861 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a577a54d-1133-4a20-bf6d-c90810fb3664 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.474802 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a577a54d-1133-4a20-bf6d-c90810fb3664 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1214 microversion: 2.1 time: 0.074081 Oct 28 08:40:49.475607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 103/186] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:49 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:49.479665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-74180aba-a24a-41fd-be31-b22ad9646809 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:49.480259 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-74180aba-a24a-41fd-be31-b22ad9646809 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:49.486091 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-74180aba-a24a-41fd-be31-b22ad9646809 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.486534 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-74180aba-a24a-41fd-be31-b22ad9646809 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.487297 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-74180aba-a24a-41fd-be31-b22ad9646809 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.487725 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-74180aba-a24a-41fd-be31-b22ad9646809 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.620674 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-74180aba-a24a-41fd-be31-b22ad9646809 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.631184 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-74180aba-a24a-41fd-be31-b22ad9646809 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.154392 Oct 28 08:40:49.632141 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 104/187] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:49 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:49.639641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-302b046c-6eaa-4b91-8c46-3c9a10e20166 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:49.640642 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-302b046c-6eaa-4b91-8c46-3c9a10e20166 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:49.657865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-302b046c-6eaa-4b91-8c46-3c9a10e20166 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.657865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-302b046c-6eaa-4b91-8c46-3c9a10e20166 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.657865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-302b046c-6eaa-4b91-8c46-3c9a10e20166 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.657865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-302b046c-6eaa-4b91-8c46-3c9a10e20166 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.805768 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-302b046c-6eaa-4b91-8c46-3c9a10e20166 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.814110 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-302b046c-6eaa-4b91-8c46-3c9a10e20166 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.180646 Oct 28 08:40:49.814976 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 105/188] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:49 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:50.415582 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e19980fe-8ec7-42e0-b591-ced024ab66f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:50.416335 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e19980fe-8ec7-42e0-b591-ced024ab66f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:50.422558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e19980fe-8ec7-42e0-b591-ced024ab66f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.423003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e19980fe-8ec7-42e0-b591-ced024ab66f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.423773 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e19980fe-8ec7-42e0-b591-ced024ab66f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.424209 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e19980fe-8ec7-42e0-b591-ced024ab66f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.492441 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e19980fe-8ec7-42e0-b591-ced024ab66f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:50.500218 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e19980fe-8ec7-42e0-b591-ced024ab66f1 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1510 microversion: 2.1 time: 0.088564 Oct 28 08:40:50.500781 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 106/189] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:50 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:50.505056 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b3beab17-8fe9-402b-9fed-48a549fac1b9 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:50.505654 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b3beab17-8fe9-402b-9fed-48a549fac1b9 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:50.511464 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3beab17-8fe9-402b-9fed-48a549fac1b9 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.511905 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3beab17-8fe9-402b-9fed-48a549fac1b9 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.512698 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3beab17-8fe9-402b-9fed-48a549fac1b9 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.513135 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3beab17-8fe9-402b-9fed-48a549fac1b9 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.575612 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b3beab17-8fe9-402b-9fed-48a549fac1b9 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:50.582870 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b3beab17-8fe9-402b-9fed-48a549fac1b9 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1218 microversion: 2.1 time: 0.081058 Oct 28 08:40:50.583503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 107/190] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:50 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:50.648568 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bf26f62f-00dd-4379-b3dc-0c250161ebcc tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:50.649171 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bf26f62f-00dd-4379-b3dc-0c250161ebcc tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:50.655117 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf26f62f-00dd-4379-b3dc-0c250161ebcc tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.655563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf26f62f-00dd-4379-b3dc-0c250161ebcc tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.656324 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf26f62f-00dd-4379-b3dc-0c250161ebcc tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.656752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf26f62f-00dd-4379-b3dc-0c250161ebcc tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.786949 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-bf26f62f-00dd-4379-b3dc-0c250161ebcc tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:50.794485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bf26f62f-00dd-4379-b3dc-0c250161ebcc tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.149779 Oct 28 08:40:50.795058 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 108/191] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:50 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:50.834644 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-16bd4bbf-4a34-4eb8-8f81-5b415838bf85 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:50.835300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-16bd4bbf-4a34-4eb8-8f81-5b415838bf85 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:50.841510 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-16bd4bbf-4a34-4eb8-8f81-5b415838bf85 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.841984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-16bd4bbf-4a34-4eb8-8f81-5b415838bf85 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.842748 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-16bd4bbf-4a34-4eb8-8f81-5b415838bf85 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.843173 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-16bd4bbf-4a34-4eb8-8f81-5b415838bf85 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.968770 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-16bd4bbf-4a34-4eb8-8f81-5b415838bf85 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:50.976223 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-16bd4bbf-4a34-4eb8-8f81-5b415838bf85 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.147306 Oct 28 08:40:50.976789 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 109/192] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:50 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:51.519253 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a6534c13-56cb-4b81-a19e-6af58a8586d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:51.520777 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a6534c13-56cb-4b81-a19e-6af58a8586d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:51.527329 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6534c13-56cb-4b81-a19e-6af58a8586d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.527768 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6534c13-56cb-4b81-a19e-6af58a8586d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.528532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6534c13-56cb-4b81-a19e-6af58a8586d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.528957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6534c13-56cb-4b81-a19e-6af58a8586d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.593767 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a6534c13-56cb-4b81-a19e-6af58a8586d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:51.602486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a6534c13-56cb-4b81-a19e-6af58a8586d3 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.088856 Oct 28 08:40:51.602976 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 110/193] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:51 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:51.607102 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bf979cc9-6111-415b-972c-09f57356333a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:51.607706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bf979cc9-6111-415b-972c-09f57356333a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:51.613855 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf979cc9-6111-415b-972c-09f57356333a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.614957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf979cc9-6111-415b-972c-09f57356333a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.615742 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf979cc9-6111-415b-972c-09f57356333a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.616164 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf979cc9-6111-415b-972c-09f57356333a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.677053 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-bf979cc9-6111-415b-972c-09f57356333a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:51.684441 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bf979cc9-6111-415b-972c-09f57356333a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1218 microversion: 2.1 time: 0.080488 Oct 28 08:40:51.685009 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 111/194] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:51 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:51.811556 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2c534ee9-1905-48fc-a47a-a32072fefd1a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:51.812146 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2c534ee9-1905-48fc-a47a-a32072fefd1a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:51.819221 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c534ee9-1905-48fc-a47a-a32072fefd1a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.819652 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c534ee9-1905-48fc-a47a-a32072fefd1a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.820434 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c534ee9-1905-48fc-a47a-a32072fefd1a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.820871 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c534ee9-1905-48fc-a47a-a32072fefd1a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.951874 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2c534ee9-1905-48fc-a47a-a32072fefd1a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:51.959833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2c534ee9-1905-48fc-a47a-a32072fefd1a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.151899 Oct 28 08:40:51.960406 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 112/195] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:51 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:51.994246 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fb332f35-e4a7-4708-a477-3956c64d4c81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:51.994856 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fb332f35-e4a7-4708-a477-3956c64d4c81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:52.000802 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb332f35-e4a7-4708-a477-3956c64d4c81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.001247 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb332f35-e4a7-4708-a477-3956c64d4c81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.002061 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb332f35-e4a7-4708-a477-3956c64d4c81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.002489 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb332f35-e4a7-4708-a477-3956c64d4c81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.128409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fb332f35-e4a7-4708-a477-3956c64d4c81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:52.136256 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fb332f35-e4a7-4708-a477-3956c64d4c81 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.145742 Oct 28 08:40:52.136844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 113/196] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:51 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:52.619825 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-58d6977d-a1f3-444e-af01-d58743997c30 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:52.620489 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-58d6977d-a1f3-444e-af01-d58743997c30 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:52.626964 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-58d6977d-a1f3-444e-af01-d58743997c30 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.627405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-58d6977d-a1f3-444e-af01-d58743997c30 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.628198 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-58d6977d-a1f3-444e-af01-d58743997c30 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.628625 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-58d6977d-a1f3-444e-af01-d58743997c30 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.695774 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-58d6977d-a1f3-444e-af01-d58743997c30 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:52.703905 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-58d6977d-a1f3-444e-af01-d58743997c30 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.087621 Oct 28 08:40:52.704694 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 114/197] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:52 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:52.710665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-26a00777-3202-466a-bdf8-adb124b42c2b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:52.711148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-26a00777-3202-466a-bdf8-adb124b42c2b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:52.717201 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-26a00777-3202-466a-bdf8-adb124b42c2b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.717666 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-26a00777-3202-466a-bdf8-adb124b42c2b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.718466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-26a00777-3202-466a-bdf8-adb124b42c2b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.718893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-26a00777-3202-466a-bdf8-adb124b42c2b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.780722 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-26a00777-3202-466a-bdf8-adb124b42c2b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:52.788649 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-26a00777-3202-466a-bdf8-adb124b42c2b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1218 microversion: 2.1 time: 0.082825 Oct 28 08:40:52.789218 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 115/198] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:52 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:52.867441 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8f241379-d15f-4e4b-9e06-086560c4bb7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 18449 microversion: 2.1 time: 4.454588 Oct 28 08:40:52.868171 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 84/199] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:48 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 18449 bytes in 4456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:40:52.977244 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ff9f82ff-767d-484b-bf0c-7376ec945692 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:52.977734 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ff9f82ff-767d-484b-bf0c-7376ec945692 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:52.983535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ff9f82ff-767d-484b-bf0c-7376ec945692 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.983979 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ff9f82ff-767d-484b-bf0c-7376ec945692 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.984742 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ff9f82ff-767d-484b-bf0c-7376ec945692 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.985175 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ff9f82ff-767d-484b-bf0c-7376ec945692 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.113932 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ff9f82ff-767d-484b-bf0c-7376ec945692 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:53.128535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ff9f82ff-767d-484b-bf0c-7376ec945692 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.155698 Oct 28 08:40:53.129892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 116/200] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:52 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:53.154091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ba8123de-4162-4e53-9933-ff5adae8663a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:53.154791 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ba8123de-4162-4e53-9933-ff5adae8663a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:53.161740 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ba8123de-4162-4e53-9933-ff5adae8663a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.162228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ba8123de-4162-4e53-9933-ff5adae8663a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.163037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ba8123de-4162-4e53-9933-ff5adae8663a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.163469 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ba8123de-4162-4e53-9933-ff5adae8663a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.293459 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ba8123de-4162-4e53-9933-ff5adae8663a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:53.301258 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ba8123de-4162-4e53-9933-ff5adae8663a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.151208 Oct 28 08:40:53.301833 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 85/201] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:53 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:53.720332 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-05b6e0bb-79c5-4ac2-9ca4-81078cd97f95 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:53.720930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-05b6e0bb-79c5-4ac2-9ca4-81078cd97f95 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:53.728729 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05b6e0bb-79c5-4ac2-9ca4-81078cd97f95 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.729043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05b6e0bb-79c5-4ac2-9ca4-81078cd97f95 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.729833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05b6e0bb-79c5-4ac2-9ca4-81078cd97f95 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.730262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05b6e0bb-79c5-4ac2-9ca4-81078cd97f95 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.794864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-05b6e0bb-79c5-4ac2-9ca4-81078cd97f95 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:53.805326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0bc608d2-5e7f-41a8-b2cf-694ca3f646c6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:53.805971 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0bc608d2-5e7f-41a8-b2cf-694ca3f646c6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:53.808445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-05b6e0bb-79c5-4ac2-9ca4-81078cd97f95 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.091534 Oct 28 08:40:53.816850 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 117/202] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:53 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:53.817828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0bc608d2-5e7f-41a8-b2cf-694ca3f646c6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.817828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0bc608d2-5e7f-41a8-b2cf-694ca3f646c6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.817828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0bc608d2-5e7f-41a8-b2cf-694ca3f646c6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.817828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0bc608d2-5e7f-41a8-b2cf-694ca3f646c6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.878741 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bf129b54-e40d-4d68-946a-12be9f5a414e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:53.880738 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bf129b54-e40d-4d68-946a-12be9f5a414e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:53.883102 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0bc608d2-5e7f-41a8-b2cf-694ca3f646c6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:53.887968 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf129b54-e40d-4d68-946a-12be9f5a414e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.888420 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf129b54-e40d-4d68-946a-12be9f5a414e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.889182 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf129b54-e40d-4d68-946a-12be9f5a414e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.889927 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf129b54-e40d-4d68-946a-12be9f5a414e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.891488 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0bc608d2-5e7f-41a8-b2cf-694ca3f646c6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1266 microversion: 2.1 time: 0.089758 Oct 28 08:40:53.892067 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 86/203] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:53 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:54.146906 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-75fce8a1-3979-4010-b252-136acd75530f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:54.147518 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-75fce8a1-3979-4010-b252-136acd75530f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:54.153614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-75fce8a1-3979-4010-b252-136acd75530f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.154095 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-75fce8a1-3979-4010-b252-136acd75530f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.154884 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-75fce8a1-3979-4010-b252-136acd75530f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.155310 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-75fce8a1-3979-4010-b252-136acd75530f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.286684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-75fce8a1-3979-4010-b252-136acd75530f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:54.294008 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-75fce8a1-3979-4010-b252-136acd75530f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.151600 Oct 28 08:40:54.294571 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 87/204] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:54 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:54.318521 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-81f7a828-60da-4bc6-9e4d-41fbd2bc3543 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:54.319131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-81f7a828-60da-4bc6-9e4d-41fbd2bc3543 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:54.325590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-81f7a828-60da-4bc6-9e4d-41fbd2bc3543 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.326054 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-81f7a828-60da-4bc6-9e4d-41fbd2bc3543 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.326857 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-81f7a828-60da-4bc6-9e4d-41fbd2bc3543 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.327285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-81f7a828-60da-4bc6-9e4d-41fbd2bc3543 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.459666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-81f7a828-60da-4bc6-9e4d-41fbd2bc3543 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:54.466947 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-81f7a828-60da-4bc6-9e4d-41fbd2bc3543 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.152175 Oct 28 08:40:54.467538 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 88/205] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:54 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:54.824878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-812fe726-3f34-4363-95c1-f8088dad1c76 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:54.825403 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-812fe726-3f34-4363-95c1-f8088dad1c76 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:54.833466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-812fe726-3f34-4363-95c1-f8088dad1c76 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.833941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-812fe726-3f34-4363-95c1-f8088dad1c76 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.834709 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-812fe726-3f34-4363-95c1-f8088dad1c76 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.835144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-812fe726-3f34-4363-95c1-f8088dad1c76 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.900072 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-812fe726-3f34-4363-95c1-f8088dad1c76 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:54.908043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-812fe726-3f34-4363-95c1-f8088dad1c76 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.086894 Oct 28 08:40:54.908619 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 89/206] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:54 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:54.913129 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-01eb7018-6864-44fd-ae14-164fdfa1a2e4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:54.913728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-01eb7018-6864-44fd-ae14-164fdfa1a2e4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:54.919619 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01eb7018-6864-44fd-ae14-164fdfa1a2e4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.920138 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01eb7018-6864-44fd-ae14-164fdfa1a2e4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.920891 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01eb7018-6864-44fd-ae14-164fdfa1a2e4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.921314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01eb7018-6864-44fd-ae14-164fdfa1a2e4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.983232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-01eb7018-6864-44fd-ae14-164fdfa1a2e4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:54.990685 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-01eb7018-6864-44fd-ae14-164fdfa1a2e4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1266 microversion: 2.1 time: 0.081115 Oct 28 08:40:54.991263 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 90/207] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:54 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:55.311610 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9f9c3bcb-3aa7-4955-9e2b-96317b0b31eb tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:55.312207 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9f9c3bcb-3aa7-4955-9e2b-96317b0b31eb tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:55.319098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9c3bcb-3aa7-4955-9e2b-96317b0b31eb tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.319540 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9c3bcb-3aa7-4955-9e2b-96317b0b31eb tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.320314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9c3bcb-3aa7-4955-9e2b-96317b0b31eb tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.320781 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9c3bcb-3aa7-4955-9e2b-96317b0b31eb tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.447317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9f9c3bcb-3aa7-4955-9e2b-96317b0b31eb tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:55.454781 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9f9c3bcb-3aa7-4955-9e2b-96317b0b31eb tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.147020 Oct 28 08:40:55.455349 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 91/208] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:55 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:55.492473 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6fd3ddcb-e717-4570-8d80-92399baf82e6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:55.493105 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6fd3ddcb-e717-4570-8d80-92399baf82e6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:55.499012 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fd3ddcb-e717-4570-8d80-92399baf82e6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.499447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fd3ddcb-e717-4570-8d80-92399baf82e6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.500204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fd3ddcb-e717-4570-8d80-92399baf82e6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.500636 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fd3ddcb-e717-4570-8d80-92399baf82e6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.637899 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6fd3ddcb-e717-4570-8d80-92399baf82e6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:55.646100 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6fd3ddcb-e717-4570-8d80-92399baf82e6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.157779 Oct 28 08:40:55.646675 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 92/209] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:55 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:55.925490 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ccf489fe-56d3-4911-906f-6c0251c8a36c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:55.926909 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ccf489fe-56d3-4911-906f-6c0251c8a36c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:55.933988 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ccf489fe-56d3-4911-906f-6c0251c8a36c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.934357 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ccf489fe-56d3-4911-906f-6c0251c8a36c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.935151 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ccf489fe-56d3-4911-906f-6c0251c8a36c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.935583 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ccf489fe-56d3-4911-906f-6c0251c8a36c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.996653 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ccf489fe-56d3-4911-906f-6c0251c8a36c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:56.004793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ccf489fe-56d3-4911-906f-6c0251c8a36c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.082960 Oct 28 08:40:56.005363 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 93/210] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:55 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:56.009618 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5841d8ae-73b9-4f63-b30f-4b487869d9e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:56.010224 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5841d8ae-73b9-4f63-b30f-4b487869d9e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:56.016380 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5841d8ae-73b9-4f63-b30f-4b487869d9e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:56.016834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5841d8ae-73b9-4f63-b30f-4b487869d9e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:56.017596 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5841d8ae-73b9-4f63-b30f-4b487869d9e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:56.018312 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5841d8ae-73b9-4f63-b30f-4b487869d9e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:56.079798 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5841d8ae-73b9-4f63-b30f-4b487869d9e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:56.088035 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5841d8ae-73b9-4f63-b30f-4b487869d9e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1266 microversion: 2.1 time: 0.081569 Oct 28 08:40:56.088622 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 94/211] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:56 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:56.478822 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f39b3033-d29e-4dea-87f3-f6ef7741a6b7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:56.479335 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f39b3033-d29e-4dea-87f3-f6ef7741a6b7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:56.485195 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f39b3033-d29e-4dea-87f3-f6ef7741a6b7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:56.485641 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f39b3033-d29e-4dea-87f3-f6ef7741a6b7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:56.486421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f39b3033-d29e-4dea-87f3-f6ef7741a6b7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:56.486848 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f39b3033-d29e-4dea-87f3-f6ef7741a6b7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:56.616047 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f39b3033-d29e-4dea-87f3-f6ef7741a6b7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:56.623342 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f39b3033-d29e-4dea-87f3-f6ef7741a6b7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.148247 Oct 28 08:40:56.623903 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 95/212] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:56 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:56.663198 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3058ed12-b075-46a9-9a16-74c20ad03379 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:56.663815 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3058ed12-b075-46a9-9a16-74c20ad03379 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:56.669927 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3058ed12-b075-46a9-9a16-74c20ad03379 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:56.670369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3058ed12-b075-46a9-9a16-74c20ad03379 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:56.671140 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3058ed12-b075-46a9-9a16-74c20ad03379 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:56.671567 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3058ed12-b075-46a9-9a16-74c20ad03379 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:56.797203 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3058ed12-b075-46a9-9a16-74c20ad03379 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:56.804596 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3058ed12-b075-46a9-9a16-74c20ad03379 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.145649 Oct 28 08:40:56.805169 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 96/213] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:56 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:57.022306 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bf129b54-e40d-4d68-946a-12be9f5a414e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 23222 microversion: 2.1 time: 3.146340 Oct 28 08:40:57.022918 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 118/214] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:53 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 23222 bytes in 3149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:40:57.029057 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-648c128c-710f-42b7-aaad-f93811368951 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:57.029679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-648c128c-710f-42b7-aaad-f93811368951 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:57.036701 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-648c128c-710f-42b7-aaad-f93811368951 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.037141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-648c128c-710f-42b7-aaad-f93811368951 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.037975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-648c128c-710f-42b7-aaad-f93811368951 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.038430 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-648c128c-710f-42b7-aaad-f93811368951 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.098840 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-648c128c-710f-42b7-aaad-f93811368951 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.106369 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fcc82878-5ce1-468c-8efd-76568040e2d4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:57.107222 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fcc82878-5ce1-468c-8efd-76568040e2d4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:57.107422 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-648c128c-710f-42b7-aaad-f93811368951 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.089601 Oct 28 08:40:57.107926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 97/215] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:57 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:57.117030 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fcc82878-5ce1-468c-8efd-76568040e2d4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.117625 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fcc82878-5ce1-468c-8efd-76568040e2d4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.119138 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fcc82878-5ce1-468c-8efd-76568040e2d4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.119609 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fcc82878-5ce1-468c-8efd-76568040e2d4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.183594 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fcc82878-5ce1-468c-8efd-76568040e2d4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.191947 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fcc82878-5ce1-468c-8efd-76568040e2d4 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1266 microversion: 2.1 time: 0.089787 Oct 28 08:40:57.192778 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 119/216] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:57 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:57.640067 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-00ad9458-6582-4491-9eed-09b82bf409aa tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:57.640832 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-00ad9458-6582-4491-9eed-09b82bf409aa tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:57.647395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-00ad9458-6582-4491-9eed-09b82bf409aa tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.647832 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-00ad9458-6582-4491-9eed-09b82bf409aa tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.648637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-00ad9458-6582-4491-9eed-09b82bf409aa tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.649083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-00ad9458-6582-4491-9eed-09b82bf409aa tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.777034 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-00ad9458-6582-4491-9eed-09b82bf409aa tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.784269 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-00ad9458-6582-4491-9eed-09b82bf409aa tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.147812 Oct 28 08:40:57.784824 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 98/217] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:57 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:57.821885 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fba19cb1-247a-4ef5-bff1-7a9d3f68e58f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:57.822478 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fba19cb1-247a-4ef5-bff1-7a9d3f68e58f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:57.828651 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fba19cb1-247a-4ef5-bff1-7a9d3f68e58f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.829088 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fba19cb1-247a-4ef5-bff1-7a9d3f68e58f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.829980 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fba19cb1-247a-4ef5-bff1-7a9d3f68e58f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.830405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fba19cb1-247a-4ef5-bff1-7a9d3f68e58f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.956266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fba19cb1-247a-4ef5-bff1-7a9d3f68e58f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.964736 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fba19cb1-247a-4ef5-bff1-7a9d3f68e58f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.146430 Oct 28 08:40:57.965333 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 120/218] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:57 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:58.034102 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-76cb5527-b296-44df-aeff-7e650a10ecdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:58.035090 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-76cb5527-b296-44df-aeff-7e650a10ecdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:58.042248 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76cb5527-b296-44df-aeff-7e650a10ecdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.042683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76cb5527-b296-44df-aeff-7e650a10ecdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.043447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76cb5527-b296-44df-aeff-7e650a10ecdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.043869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76cb5527-b296-44df-aeff-7e650a10ecdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.124169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-582eb763-a276-488d-ae20-28eaf1ee502b tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:58.124847 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-582eb763-a276-488d-ae20-28eaf1ee502b tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:58.131713 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-582eb763-a276-488d-ae20-28eaf1ee502b tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.132153 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-582eb763-a276-488d-ae20-28eaf1ee502b tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.132938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-582eb763-a276-488d-ae20-28eaf1ee502b tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.133368 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-582eb763-a276-488d-ae20-28eaf1ee502b tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.181440 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-76cb5527-b296-44df-aeff-7e650a10ecdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 25992 microversion: 2.1 time: 0.150827 Oct 28 08:40:58.183008 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 99/219] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:58 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 25992 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:40:58.211168 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a7a23d22-446e-4f82-93b0-7d59748f6ae1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:58.212333 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a7a23d22-446e-4f82-93b0-7d59748f6ae1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:58.222240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a7a23d22-446e-4f82-93b0-7d59748f6ae1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.223255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a7a23d22-446e-4f82-93b0-7d59748f6ae1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.224264 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a7a23d22-446e-4f82-93b0-7d59748f6ae1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.224933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a7a23d22-446e-4f82-93b0-7d59748f6ae1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.229600 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-582eb763-a276-488d-ae20-28eaf1ee502b tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:58.238031 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-582eb763-a276-488d-ae20-28eaf1ee502b tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.117660 Oct 28 08:40:58.244213 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 121/220] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:58 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:58.315625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a7a23d22-446e-4f82-93b0-7d59748f6ae1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:58.334170 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a7a23d22-446e-4f82-93b0-7d59748f6ae1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1272 microversion: 2.1 time: 0.128085 Oct 28 08:40:58.344332 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 100/221] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:58 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:58.801883 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9d2bb62c-73af-482c-90fa-7d943c450a15 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:58.803182 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9d2bb62c-73af-482c-90fa-7d943c450a15 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:58.813852 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d2bb62c-73af-482c-90fa-7d943c450a15 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.814314 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d2bb62c-73af-482c-90fa-7d943c450a15 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.815476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d2bb62c-73af-482c-90fa-7d943c450a15 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.816198 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d2bb62c-73af-482c-90fa-7d943c450a15 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.982174 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9951e990-f886-4ca0-baa8-b53f408be7cb tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:58.982820 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9951e990-f886-4ca0-baa8-b53f408be7cb tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:58.989680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9951e990-f886-4ca0-baa8-b53f408be7cb tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.990084 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9951e990-f886-4ca0-baa8-b53f408be7cb tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.990871 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9951e990-f886-4ca0-baa8-b53f408be7cb tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.991297 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9951e990-f886-4ca0-baa8-b53f408be7cb tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.301508 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9d2bb62c-73af-482c-90fa-7d943c450a15 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:59.311476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9d2bb62c-73af-482c-90fa-7d943c450a15 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1318 microversion: 2.1 time: 0.514261 Oct 28 08:40:59.312068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 122/222] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:58 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:59.317210 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-307d5e4e-9a7a-4ac3-8149-57326ef70976 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:59.318650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-307d5e4e-9a7a-4ac3-8149-57326ef70976 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:59.325164 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-307d5e4e-9a7a-4ac3-8149-57326ef70976 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.325616 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-307d5e4e-9a7a-4ac3-8149-57326ef70976 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.326432 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-307d5e4e-9a7a-4ac3-8149-57326ef70976 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.326692 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9951e990-f886-4ca0-baa8-b53f408be7cb tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:59.327162 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-307d5e4e-9a7a-4ac3-8149-57326ef70976 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.335445 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9951e990-f886-4ca0-baa8-b53f408be7cb tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.356862 Oct 28 08:40:59.336569 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 101/223] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:58 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:59.341328 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f8694856-4e29-4f50-95af-8e584701c37c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:59.342029 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f8694856-4e29-4f50-95af-8e584701c37c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:59.351836 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f8694856-4e29-4f50-95af-8e584701c37c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.352103 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f8694856-4e29-4f50-95af-8e584701c37c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.352964 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f8694856-4e29-4f50-95af-8e584701c37c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.353590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f8694856-4e29-4f50-95af-8e584701c37c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.431780 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f8694856-4e29-4f50-95af-8e584701c37c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:59.440259 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f8694856-4e29-4f50-95af-8e584701c37c tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.102521 Oct 28 08:40:59.440921 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 102/224] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:59 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:59.446290 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c43c2f65-85c6-4d32-9f0f-53ef82469d96 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:59.447193 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c43c2f65-85c6-4d32-9f0f-53ef82469d96 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:59.453392 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c43c2f65-85c6-4d32-9f0f-53ef82469d96 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.454085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c43c2f65-85c6-4d32-9f0f-53ef82469d96 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.455057 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c43c2f65-85c6-4d32-9f0f-53ef82469d96 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.455684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c43c2f65-85c6-4d32-9f0f-53ef82469d96 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.687192 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c43c2f65-85c6-4d32-9f0f-53ef82469d96 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:59.699398 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c43c2f65-85c6-4d32-9f0f-53ef82469d96 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.257169 Oct 28 08:40:59.699983 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 103/225] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:59 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:59.876691 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-4f7e2172-c4a8-483a-949c-39f62547c921 req-3338b51e-339b-42a4-8183-4a75afe4e380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01160f21-7cfb-4fd7-99fa-f9d7fa21acd5", "tag": "df7df76e-bd7c-4f8c-93e3-b04d53cccf2e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:59.878589 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:59.878589 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:40:59.895846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-4f7e2172-c4a8-483a-949c-39f62547c921 req-3338b51e-339b-42a4-8183-4a75afe4e380 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.896487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-4f7e2172-c4a8-483a-949c-39f62547c921 req-3338b51e-339b-42a4-8183-4a75afe4e380 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.908969 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-4f7e2172-c4a8-483a-949c-39f62547c921 req-3338b51e-339b-42a4-8183-4a75afe4e380 service nova] Creating event network-changed:df7df76e-bd7c-4f8c-93e3-b04d53cccf2e for instance 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 on hv-cinder-81566 Oct 28 08:40:59.914274 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-4f7e2172-c4a8-483a-949c-39f62547c921 req-3338b51e-339b-42a4-8183-4a75afe4e380 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041523 Oct 28 08:40:59.914929 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 104/226] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:00.331028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dce34080-ea3c-4d7a-bbe8-c34b17fbd65c tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:00.331925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dce34080-ea3c-4d7a-bbe8-c34b17fbd65c tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:00.339169 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dce34080-ea3c-4d7a-bbe8-c34b17fbd65c tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:00.339712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dce34080-ea3c-4d7a-bbe8-c34b17fbd65c tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:00.340538 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dce34080-ea3c-4d7a-bbe8-c34b17fbd65c tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:00.341081 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dce34080-ea3c-4d7a-bbe8-c34b17fbd65c tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:00.484579 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dce34080-ea3c-4d7a-bbe8-c34b17fbd65c tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:00.492738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dce34080-ea3c-4d7a-bbe8-c34b17fbd65c tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1506 microversion: 2.1 time: 0.167619 Oct 28 08:41:00.493306 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 105/227] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:00 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:00.497711 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-888143e2-3c99-44b7-8f4b-dc020015111a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:00.498347 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-888143e2-3c99-44b7-8f4b-dc020015111a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:00.504051 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-888143e2-3c99-44b7-8f4b-dc020015111a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:00.504839 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-888143e2-3c99-44b7-8f4b-dc020015111a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:00.505389 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-888143e2-3c99-44b7-8f4b-dc020015111a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:00.505843 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-888143e2-3c99-44b7-8f4b-dc020015111a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:00.681347 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-888143e2-3c99-44b7-8f4b-dc020015111a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:00.692629 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-888143e2-3c99-44b7-8f4b-dc020015111a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.197493 Oct 28 08:41:00.693539 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 106/228] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:00 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:00.707041 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-14632060-66c3-402a-a15f-08801977c297 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:00.709275 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-14632060-66c3-402a-a15f-08801977c297 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:00.717622 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14632060-66c3-402a-a15f-08801977c297 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:00.718267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14632060-66c3-402a-a15f-08801977c297 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:00.719038 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14632060-66c3-402a-a15f-08801977c297 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:00.719466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-14632060-66c3-402a-a15f-08801977c297 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:00.790528 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-14632060-66c3-402a-a15f-08801977c297 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:00.804548 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-14632060-66c3-402a-a15f-08801977c297 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.109290 Oct 28 08:41:00.805545 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 107/229] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:00 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:00.812408 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c60aa612-e0ad-4040-bc7f-256174007a50 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:00.813010 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c60aa612-e0ad-4040-bc7f-256174007a50 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:00.820137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c60aa612-e0ad-4040-bc7f-256174007a50 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:00.820921 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c60aa612-e0ad-4040-bc7f-256174007a50 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:00.821705 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c60aa612-e0ad-4040-bc7f-256174007a50 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:00.822160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c60aa612-e0ad-4040-bc7f-256174007a50 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:00.958653 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c60aa612-e0ad-4040-bc7f-256174007a50 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:00.968824 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c60aa612-e0ad-4040-bc7f-256174007a50 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.161623 Oct 28 08:41:00.969569 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 108/230] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:00 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:01.710388 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5172b882-fe4b-4f93-bbf7-2b34a702c713 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:01.711316 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5172b882-fe4b-4f93-bbf7-2b34a702c713 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:01.723744 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5172b882-fe4b-4f93-bbf7-2b34a702c713 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:01.724252 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5172b882-fe4b-4f93-bbf7-2b34a702c713 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:01.725080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5172b882-fe4b-4f93-bbf7-2b34a702c713 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:01.725584 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5172b882-fe4b-4f93-bbf7-2b34a702c713 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:01.859655 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5172b882-fe4b-4f93-bbf7-2b34a702c713 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:01.867369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5172b882-fe4b-4f93-bbf7-2b34a702c713 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.161390 Oct 28 08:41:01.868014 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 109/231] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:01 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:01.872156 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d92e5ae0-93a2-49ad-91ee-2a5f6cfc7919 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:01.872821 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d92e5ae0-93a2-49ad-91ee-2a5f6cfc7919 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:01.878966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d92e5ae0-93a2-49ad-91ee-2a5f6cfc7919 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:01.880321 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d92e5ae0-93a2-49ad-91ee-2a5f6cfc7919 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:01.880671 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d92e5ae0-93a2-49ad-91ee-2a5f6cfc7919 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:01.881099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d92e5ae0-93a2-49ad-91ee-2a5f6cfc7919 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:01.946301 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d92e5ae0-93a2-49ad-91ee-2a5f6cfc7919 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:01.954022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d92e5ae0-93a2-49ad-91ee-2a5f6cfc7919 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.085084 Oct 28 08:41:01.954591 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 110/232] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:01 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:01.985393 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0eea0632-5f03-41b8-95e0-71646a9bb61a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:01.986066 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0eea0632-5f03-41b8-95e0-71646a9bb61a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:01.992437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0eea0632-5f03-41b8-95e0-71646a9bb61a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:01.992885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0eea0632-5f03-41b8-95e0-71646a9bb61a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:01.993660 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0eea0632-5f03-41b8-95e0-71646a9bb61a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:01.994121 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0eea0632-5f03-41b8-95e0-71646a9bb61a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:02.125026 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0eea0632-5f03-41b8-95e0-71646a9bb61a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:02.134626 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0eea0632-5f03-41b8-95e0-71646a9bb61a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.151045 Oct 28 08:41:02.134626 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 111/233] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:01 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:02.884497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-28588600-5908-4f8d-9e5b-62323aa633ae tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:02.885190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-28588600-5908-4f8d-9e5b-62323aa633ae tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:02.892164 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28588600-5908-4f8d-9e5b-62323aa633ae tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:02.892761 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28588600-5908-4f8d-9e5b-62323aa633ae tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:02.893928 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28588600-5908-4f8d-9e5b-62323aa633ae tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:02.894617 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28588600-5908-4f8d-9e5b-62323aa633ae tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:03.155126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-28588600-5908-4f8d-9e5b-62323aa633ae tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:03.164384 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-28588600-5908-4f8d-9e5b-62323aa633ae tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.283442 Oct 28 08:41:03.165080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 112/234] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:02 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:03.169671 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-50371d9a-a606-47f0-b544-40641c3bc615 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:03.170467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-50371d9a-a606-47f0-b544-40641c3bc615 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:03.178122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-50371d9a-a606-47f0-b544-40641c3bc615 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:03.178811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-50371d9a-a606-47f0-b544-40641c3bc615 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:03.179788 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-50371d9a-a606-47f0-b544-40641c3bc615 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:03.180362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-50371d9a-a606-47f0-b544-40641c3bc615 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:03.266452 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-50371d9a-a606-47f0-b544-40641c3bc615 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:03.278151 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-50371d9a-a606-47f0-b544-40641c3bc615 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.111691 Oct 28 08:41:03.281975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 113/235] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:03 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:03.284654 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-903f31b2-cec3-4888-98ee-1f0e593b8312 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:03.285843 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-903f31b2-cec3-4888-98ee-1f0e593b8312 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:03.293672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-903f31b2-cec3-4888-98ee-1f0e593b8312 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:03.294191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-903f31b2-cec3-4888-98ee-1f0e593b8312 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:03.295161 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-903f31b2-cec3-4888-98ee-1f0e593b8312 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:03.295593 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-903f31b2-cec3-4888-98ee-1f0e593b8312 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:03.461602 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-903f31b2-cec3-4888-98ee-1f0e593b8312 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:03.469896 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-903f31b2-cec3-4888-98ee-1f0e593b8312 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.189632 Oct 28 08:41:03.472776 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 114/236] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:03 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:04.183220 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-754bcaea-b64e-4f48-aea1-4c228286d283 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:04.184561 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-754bcaea-b64e-4f48-aea1-4c228286d283 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:04.193631 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-754bcaea-b64e-4f48-aea1-4c228286d283 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:04.195641 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-754bcaea-b64e-4f48-aea1-4c228286d283 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:04.197506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-754bcaea-b64e-4f48-aea1-4c228286d283 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:04.198125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-754bcaea-b64e-4f48-aea1-4c228286d283 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:04.360394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-754bcaea-b64e-4f48-aea1-4c228286d283 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:04.382814 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-754bcaea-b64e-4f48-aea1-4c228286d283 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.204089 Oct 28 08:41:04.383510 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 115/237] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:04 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:04.388149 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5cbfc826-fa19-4e56-9c3b-ca32b1c87cb9 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:04.388816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5cbfc826-fa19-4e56-9c3b-ca32b1c87cb9 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:04.395267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5cbfc826-fa19-4e56-9c3b-ca32b1c87cb9 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:04.395780 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5cbfc826-fa19-4e56-9c3b-ca32b1c87cb9 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:04.396469 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5cbfc826-fa19-4e56-9c3b-ca32b1c87cb9 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:04.396940 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5cbfc826-fa19-4e56-9c3b-ca32b1c87cb9 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:04.464017 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5cbfc826-fa19-4e56-9c3b-ca32b1c87cb9 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:04.472730 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5cbfc826-fa19-4e56-9c3b-ca32b1c87cb9 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.088049 Oct 28 08:41:04.475095 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 116/238] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:04 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:04.490691 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-375ba960-c57c-42a0-9467-f585577f99e8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:04.492043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-375ba960-c57c-42a0-9467-f585577f99e8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:04.497232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-375ba960-c57c-42a0-9467-f585577f99e8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:04.497679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-375ba960-c57c-42a0-9467-f585577f99e8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:04.498492 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-375ba960-c57c-42a0-9467-f585577f99e8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:04.498924 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-375ba960-c57c-42a0-9467-f585577f99e8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:04.639021 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-375ba960-c57c-42a0-9467-f585577f99e8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:04.648805 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-375ba960-c57c-42a0-9467-f585577f99e8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.163610 Oct 28 08:41:04.649605 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 117/239] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:04 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:04.985686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-307d5e4e-9a7a-4ac3-8149-57326ef70976 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 27798 microversion: 2.1 time: 5.672322 Oct 28 08:41:04.989595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 123/240] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:59 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 27798 bytes in 5674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:05.401040 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b188963b-c664-4645-be97-7f2e622abda6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:05.402575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b188963b-c664-4645-be97-7f2e622abda6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:05.418655 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b188963b-c664-4645-be97-7f2e622abda6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.419446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b188963b-c664-4645-be97-7f2e622abda6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.420453 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b188963b-c664-4645-be97-7f2e622abda6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.421100 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b188963b-c664-4645-be97-7f2e622abda6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.499379 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c58035b4-e8c4-4dce-be12-0c131d4cc7ba tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:05.500406 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c58035b4-e8c4-4dce-be12-0c131d4cc7ba tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:05.513190 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c58035b4-e8c4-4dce-be12-0c131d4cc7ba tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.514214 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c58035b4-e8c4-4dce-be12-0c131d4cc7ba tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.515146 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c58035b4-e8c4-4dce-be12-0c131d4cc7ba tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.516392 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c58035b4-e8c4-4dce-be12-0c131d4cc7ba tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.706698 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c58035b4-e8c4-4dce-be12-0c131d4cc7ba tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:05.717611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c58035b4-e8c4-4dce-be12-0c131d4cc7ba tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1345 microversion: 2.1 time: 0.222071 Oct 28 08:41:05.731955 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 124/241] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:05 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1345 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:05.740455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6eb36545-4869-4267-975c-10b1432336a5 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:05.746489 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6eb36545-4869-4267-975c-10b1432336a5 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:05.755635 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6eb36545-4869-4267-975c-10b1432336a5 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.756118 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6eb36545-4869-4267-975c-10b1432336a5 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.757407 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6eb36545-4869-4267-975c-10b1432336a5 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.758030 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6eb36545-4869-4267-975c-10b1432336a5 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.864820 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b188963b-c664-4645-be97-7f2e622abda6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:05.877598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b188963b-c664-4645-be97-7f2e622abda6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.478039 Oct 28 08:41:05.878546 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 118/242] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:05 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:05.959686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6eb36545-4869-4267-975c-10b1432336a5 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:05.967513 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6eb36545-4869-4267-975c-10b1432336a5 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.234186 Oct 28 08:41:05.968437 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 125/243] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:05 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:06.000452 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-76eaf76a-80f2-48ed-bc3e-cb40ec58b194 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:06.001886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-76eaf76a-80f2-48ed-bc3e-cb40ec58b194 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:06.016356 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76eaf76a-80f2-48ed-bc3e-cb40ec58b194 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.016805 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76eaf76a-80f2-48ed-bc3e-cb40ec58b194 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:06.017632 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76eaf76a-80f2-48ed-bc3e-cb40ec58b194 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.018878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76eaf76a-80f2-48ed-bc3e-cb40ec58b194 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:06.175324 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-76eaf76a-80f2-48ed-bc3e-cb40ec58b194 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 27862 microversion: 2.1 time: 0.181246 Oct 28 08:41:06.177395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 119/244] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:05 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 27862 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:06.742647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:06.745103 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:06.762663 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.763355 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:06.764433 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.766418 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:06.852740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.854037 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:06.856167 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.objects.instance [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lazy-loading 'fault' on Instance uuid 8affc35a-332d-434c-824c-e1c8719900e7 {{(pid=132796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:41:06.904514 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c7bce0f4-60b1-48cd-8687-8db8ded62b29 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:06.905273 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c7bce0f4-60b1-48cd-8687-8db8ded62b29 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:06.918999 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7bce0f4-60b1-48cd-8687-8db8ded62b29 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.922471 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7bce0f4-60b1-48cd-8687-8db8ded62b29 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:06.927494 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7bce0f4-60b1-48cd-8687-8db8ded62b29 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.928240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7bce0f4-60b1-48cd-8687-8db8ded62b29 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.172771 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9e05166f7d465b87e180ba53fbd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb79404f2ff94257ba8afa55e780804b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:07.181245 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-40bbbd5d-746c-4189-9311-c306a19452b2 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 200 len: 1304 microversion: 2.1 time: 0.450074 Oct 28 08:41:07.196491 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 126/245] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:06 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 1304 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:07.201556 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2e1d992b-e951-468e-b96e-df0a1bc33c3b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:07.207711 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2e1d992b-e951-468e-b96e-df0a1bc33c3b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:07.221348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2e1d992b-e951-468e-b96e-df0a1bc33c3b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.222115 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2e1d992b-e951-468e-b96e-df0a1bc33c3b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.223956 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2e1d992b-e951-468e-b96e-df0a1bc33c3b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.226339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2e1d992b-e951-468e-b96e-df0a1bc33c3b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.460406 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c7bce0f4-60b1-48cd-8687-8db8ded62b29 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:07.470390 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c7bce0f4-60b1-48cd-8687-8db8ded62b29 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.572387 Oct 28 08:41:07.476278 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 120/246] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:06 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:07.488128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3d482daf-dee6-4540-999d-e456d3642917 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:07.489623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3d482daf-dee6-4540-999d-e456d3642917 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:07.503567 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d482daf-dee6-4540-999d-e456d3642917 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.504033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d482daf-dee6-4540-999d-e456d3642917 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.507683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d482daf-dee6-4540-999d-e456d3642917 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.508129 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d482daf-dee6-4540-999d-e456d3642917 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.619384 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2e1d992b-e951-468e-b96e-df0a1bc33c3b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:07.623066 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3d482daf-dee6-4540-999d-e456d3642917 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 27928 microversion: 2.1 time: 0.145043 Oct 28 08:41:07.631089 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 121/247] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:07 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 27928 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:07.633842 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2e1d992b-e951-468e-b96e-df0a1bc33c3b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.435853 Oct 28 08:41:07.634749 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 127/248] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:07 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:08.231074 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d401fd4b-1524-4669-a172-bdd7d6a7b415 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:08.233675 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d401fd4b-1524-4669-a172-bdd7d6a7b415 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:08.261668 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d401fd4b-1524-4669-a172-bdd7d6a7b415 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.262598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d401fd4b-1524-4669-a172-bdd7d6a7b415 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.265365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d401fd4b-1524-4669-a172-bdd7d6a7b415 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.266186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d401fd4b-1524-4669-a172-bdd7d6a7b415 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.294709 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-d401fd4b-1524-4669-a172-bdd7d6a7b415 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] HTTP exception thrown: Instance 8affc35a-332d-434c-824c-e1c8719900e7 could not be found. Oct 28 08:41:08.295708 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d401fd4b-1524-4669-a172-bdd7d6a7b415 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Returning 404 to user: Instance 8affc35a-332d-434c-824c-e1c8719900e7 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:08.299785 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d401fd4b-1524-4669-a172-bdd7d6a7b415 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 404 len: 111 microversion: 2.1 time: 0.089291 Oct 28 08:41:08.303325 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 122/249] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:08 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:41:08.492745 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a440f784-5a62-49ef-beaa-87499fc88ac7 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:08.493823 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a440f784-5a62-49ef-beaa-87499fc88ac7 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:08.497106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-69b7b31e-113c-463e-a523-72fbd13b7864 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:08.503486 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a440f784-5a62-49ef-beaa-87499fc88ac7 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.503996 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a440f784-5a62-49ef-beaa-87499fc88ac7 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.506094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-69b7b31e-113c-463e-a523-72fbd13b7864 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:08.508702 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a440f784-5a62-49ef-beaa-87499fc88ac7 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.509145 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a440f784-5a62-49ef-beaa-87499fc88ac7 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.536643 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-69b7b31e-113c-463e-a523-72fbd13b7864 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.537175 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-69b7b31e-113c-463e-a523-72fbd13b7864 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.538848 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-69b7b31e-113c-463e-a523-72fbd13b7864 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.541503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-69b7b31e-113c-463e-a523-72fbd13b7864 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.598506 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-69b7b31e-113c-463e-a523-72fbd13b7864 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] HTTP exception thrown: Instance 8affc35a-332d-434c-824c-e1c8719900e7 could not be found. Oct 28 08:41:08.600200 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-69b7b31e-113c-463e-a523-72fbd13b7864 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Returning 404 to user: Instance 8affc35a-332d-434c-824c-e1c8719900e7 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:08.601276 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-69b7b31e-113c-463e-a523-72fbd13b7864 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.117253 Oct 28 08:41:08.602326 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 128/250] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:41:08 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7/os-volume_attachments => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:41:08.651824 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5a3212d1-ae88-4f99-b0b8-bd2185f637d7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:08.655652 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5a3212d1-ae88-4f99-b0b8-bd2185f637d7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:08.673673 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a3212d1-ae88-4f99-b0b8-bd2185f637d7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.674562 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a3212d1-ae88-4f99-b0b8-bd2185f637d7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.675553 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a3212d1-ae88-4f99-b0b8-bd2185f637d7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.676771 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a3212d1-ae88-4f99-b0b8-bd2185f637d7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.795148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5a3212d1-ae88-4f99-b0b8-bd2185f637d7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28107 microversion: 2.1 time: 0.156975 Oct 28 08:41:08.796635 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 129/251] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:08 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28107 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:08.824398 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-30c41216-c657-48f5-85d9-fe8903427e0c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:08.827873 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-30c41216-c657-48f5-85d9-fe8903427e0c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:08.844340 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-30c41216-c657-48f5-85d9-fe8903427e0c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.846703 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-30c41216-c657-48f5-85d9-fe8903427e0c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.851760 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-30c41216-c657-48f5-85d9-fe8903427e0c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.853771 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-30c41216-c657-48f5-85d9-fe8903427e0c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.938360 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a440f784-5a62-49ef-beaa-87499fc88ac7 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:08.948963 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a440f784-5a62-49ef-beaa-87499fc88ac7 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.461094 Oct 28 08:41:08.956126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 123/252] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:08 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:09.090737 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-30c41216-c657-48f5-85d9-fe8903427e0c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:09.108237 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-30c41216-c657-48f5-85d9-fe8903427e0c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.309762 Oct 28 08:41:09.110427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 130/253] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:08 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:09.809188 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f4c5354b-d766-4cba-bc1c-e931effc6b1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:09.810381 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f4c5354b-d766-4cba-bc1c-e931effc6b1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:09.823958 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f4c5354b-d766-4cba-bc1c-e931effc6b1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:09.830355 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f4c5354b-d766-4cba-bc1c-e931effc6b1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:09.833178 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f4c5354b-d766-4cba-bc1c-e931effc6b1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:09.833621 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f4c5354b-d766-4cba-bc1c-e931effc6b1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:09.968681 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b0b288c7-627b-43bc-8c26-869b0a44eb82 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:09.969507 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b0b288c7-627b-43bc-8c26-869b0a44eb82 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:09.989729 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b0b288c7-627b-43bc-8c26-869b0a44eb82 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:09.989949 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b0b288c7-627b-43bc-8c26-869b0a44eb82 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:09.991066 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b0b288c7-627b-43bc-8c26-869b0a44eb82 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:09.991513 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b0b288c7-627b-43bc-8c26-869b0a44eb82 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.043811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f4c5354b-d766-4cba-bc1c-e931effc6b1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.239553 Oct 28 08:41:10.048811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 124/254] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:09 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:10.138434 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e1a9c34b-d87e-4179-bd22-b77cfb74e96b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:10.139319 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e1a9c34b-d87e-4179-bd22-b77cfb74e96b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:10.172824 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e1a9c34b-d87e-4179-bd22-b77cfb74e96b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.173325 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e1a9c34b-d87e-4179-bd22-b77cfb74e96b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.182467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e1a9c34b-d87e-4179-bd22-b77cfb74e96b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.185672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e1a9c34b-d87e-4179-bd22-b77cfb74e96b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.316025 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b0b288c7-627b-43bc-8c26-869b0a44eb82 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:10.331073 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b0b288c7-627b-43bc-8c26-869b0a44eb82 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.366692 Oct 28 08:41:10.347493 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 131/255] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:09 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:10.354781 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d442b727-0cbf-469b-9cb6-e3482d65ae43 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:10.361449 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d442b727-0cbf-469b-9cb6-e3482d65ae43 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:10.372135 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d442b727-0cbf-469b-9cb6-e3482d65ae43 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.372584 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d442b727-0cbf-469b-9cb6-e3482d65ae43 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.374142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d442b727-0cbf-469b-9cb6-e3482d65ae43 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.374820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d442b727-0cbf-469b-9cb6-e3482d65ae43 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.396366 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-d442b727-0cbf-469b-9cb6-e3482d65ae43 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] HTTP exception thrown: Instance 8affc35a-332d-434c-824c-e1c8719900e7 could not be found. Oct 28 08:41:10.397512 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d442b727-0cbf-469b-9cb6-e3482d65ae43 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Returning 404 to user: Instance 8affc35a-332d-434c-824c-e1c8719900e7 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:10.399111 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d442b727-0cbf-469b-9cb6-e3482d65ae43 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "DELETE /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 404 len: 111 microversion: 2.1 time: 0.049883 Oct 28 08:41:10.400183 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 132/256] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:41:10 2021] DELETE /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:41:10.413113 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b36a728a-e9f2-43b0-8826-f458b0b3e140 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:10.414299 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b36a728a-e9f2-43b0-8826-f458b0b3e140 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] [instance: 8affc35a-332d-434c-824c-e1c8719900e7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:10.423265 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b36a728a-e9f2-43b0-8826-f458b0b3e140 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.424063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b36a728a-e9f2-43b0-8826-f458b0b3e140 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.425345 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b36a728a-e9f2-43b0-8826-f458b0b3e140 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.426704 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b36a728a-e9f2-43b0-8826-f458b0b3e140 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.450660 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-b36a728a-e9f2-43b0-8826-f458b0b3e140 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] HTTP exception thrown: Instance 8affc35a-332d-434c-824c-e1c8719900e7 could not be found. Oct 28 08:41:10.451327 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b36a728a-e9f2-43b0-8826-f458b0b3e140 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] Returning 404 to user: Instance 8affc35a-332d-434c-824c-e1c8719900e7 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:10.452247 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b36a728a-e9f2-43b0-8826-f458b0b3e140 tempest-DeleteServersTestJSON-280721089 tempest-DeleteServersTestJSON-280721089-project] 10.222.0.74 "GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7" status: 404 len: 111 microversion: 2.1 time: 0.046154 Oct 28 08:41:10.452884 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 133/257] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:10 2021] GET /compute/v2.1/servers/8affc35a-332d-434c-824c-e1c8719900e7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:41:10.672326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e1a9c34b-d87e-4179-bd22-b77cfb74e96b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:10.698309 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e1a9c34b-d87e-4179-bd22-b77cfb74e96b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.574031 Oct 28 08:41:10.699698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 125/258] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:10 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:11.057502 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6ac8b03a-b39c-4dd0-9433-1a05cc9aced6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:11.058604 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6ac8b03a-b39c-4dd0-9433-1a05cc9aced6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:11.065600 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6ac8b03a-b39c-4dd0-9433-1a05cc9aced6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.066411 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6ac8b03a-b39c-4dd0-9433-1a05cc9aced6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.068151 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6ac8b03a-b39c-4dd0-9433-1a05cc9aced6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.068802 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6ac8b03a-b39c-4dd0-9433-1a05cc9aced6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.185361 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6ac8b03a-b39c-4dd0-9433-1a05cc9aced6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.131988 Oct 28 08:41:11.190089 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 134/259] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:11 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:11.358814 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2cb7ff88-509e-4658-a0b2-3a82c9122558 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:11.361034 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2cb7ff88-509e-4658-a0b2-3a82c9122558 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:11.378238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2cb7ff88-509e-4658-a0b2-3a82c9122558 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.390913 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2cb7ff88-509e-4658-a0b2-3a82c9122558 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.391911 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2cb7ff88-509e-4658-a0b2-3a82c9122558 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.392497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2cb7ff88-509e-4658-a0b2-3a82c9122558 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.733085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2c37b1f8-a31a-43b5-bd93-6ed6a337f597 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:11.733833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2c37b1f8-a31a-43b5-bd93-6ed6a337f597 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:11.766028 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c37b1f8-a31a-43b5-bd93-6ed6a337f597 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.766488 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c37b1f8-a31a-43b5-bd93-6ed6a337f597 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.767303 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c37b1f8-a31a-43b5-bd93-6ed6a337f597 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.767736 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2c37b1f8-a31a-43b5-bd93-6ed6a337f597 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.832566 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2cb7ff88-509e-4658-a0b2-3a82c9122558 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:11.844387 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2cb7ff88-509e-4658-a0b2-3a82c9122558 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.493570 Oct 28 08:41:11.845372 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 126/260] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:11 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:12.197830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4ee91e8b-931c-46cd-9dc8-2a60fff9c322 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:12.198768 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4ee91e8b-931c-46cd-9dc8-2a60fff9c322 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:12.210298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ee91e8b-931c-46cd-9dc8-2a60fff9c322 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:12.210748 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ee91e8b-931c-46cd-9dc8-2a60fff9c322 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:12.211546 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ee91e8b-931c-46cd-9dc8-2a60fff9c322 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:12.211981 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ee91e8b-931c-46cd-9dc8-2a60fff9c322 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:12.420033 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2c37b1f8-a31a-43b5-bd93-6ed6a337f597 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:12.428793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2c37b1f8-a31a-43b5-bd93-6ed6a337f597 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.706409 Oct 28 08:41:12.438930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 135/261] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:11 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:12.617546 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4ee91e8b-931c-46cd-9dc8-2a60fff9c322 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.423162 Oct 28 08:41:12.618978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 127/262] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:12 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:12.861737 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3e1ee1d2-b984-4655-973f-bbd1deea5032 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:12.862479 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3e1ee1d2-b984-4655-973f-bbd1deea5032 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:12.878517 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e1ee1d2-b984-4655-973f-bbd1deea5032 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:12.878961 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e1ee1d2-b984-4655-973f-bbd1deea5032 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:12.880007 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e1ee1d2-b984-4655-973f-bbd1deea5032 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:12.880460 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e1ee1d2-b984-4655-973f-bbd1deea5032 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.280739 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3e1ee1d2-b984-4655-973f-bbd1deea5032 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:13.296654 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3e1ee1d2-b984-4655-973f-bbd1deea5032 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.438615 Oct 28 08:41:13.302511 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 136/263] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:12 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:13.452234 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-29f3e7d3-eeb8-442a-8ed5-64acf8abf951 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:13.452887 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-29f3e7d3-eeb8-442a-8ed5-64acf8abf951 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:13.463874 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-29f3e7d3-eeb8-442a-8ed5-64acf8abf951 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:13.464333 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-29f3e7d3-eeb8-442a-8ed5-64acf8abf951 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.465128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-29f3e7d3-eeb8-442a-8ed5-64acf8abf951 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:13.472320 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-29f3e7d3-eeb8-442a-8ed5-64acf8abf951 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.631775 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2bac63f1-3b14-4532-b39e-8101d0cd8622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:13.632807 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2bac63f1-3b14-4532-b39e-8101d0cd8622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:13.644656 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2bac63f1-3b14-4532-b39e-8101d0cd8622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:13.650765 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2bac63f1-3b14-4532-b39e-8101d0cd8622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.653308 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2bac63f1-3b14-4532-b39e-8101d0cd8622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:13.654804 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2bac63f1-3b14-4532-b39e-8101d0cd8622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.721664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-29f3e7d3-eeb8-442a-8ed5-64acf8abf951 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:13.737712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-29f3e7d3-eeb8-442a-8ed5-64acf8abf951 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.295215 Oct 28 08:41:13.739237 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 128/264] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:13 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:13.765133 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2bac63f1-3b14-4532-b39e-8101d0cd8622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.138548 Oct 28 08:41:13.770595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 137/265] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:13 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:14.321402 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-91663adc-930c-4103-beba-2c0aea3ffc8d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:14.322251 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-91663adc-930c-4103-beba-2c0aea3ffc8d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:14.375180 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-91663adc-930c-4103-beba-2c0aea3ffc8d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.409616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-91663adc-930c-4103-beba-2c0aea3ffc8d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.415317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-91663adc-930c-4103-beba-2c0aea3ffc8d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.415770 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-91663adc-930c-4103-beba-2c0aea3ffc8d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.757658 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0935f78b-94f8-4f88-bbb4-063060e5fcb3 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:14.758548 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0935f78b-94f8-4f88-bbb4-063060e5fcb3 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:14.776208 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0935f78b-94f8-4f88-bbb4-063060e5fcb3 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.784627 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0935f78b-94f8-4f88-bbb4-063060e5fcb3 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.787794 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0935f78b-94f8-4f88-bbb4-063060e5fcb3 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.788240 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0935f78b-94f8-4f88-bbb4-063060e5fcb3 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.125212 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-91663adc-930c-4103-beba-2c0aea3ffc8d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:15.132904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-91663adc-930c-4103-beba-2c0aea3ffc8d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.817194 Oct 28 08:41:15.137270 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 129/266] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:14 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:15.147845 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6d337f64-7473-4590-8d07-d0b7de2a4aa6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:15.149015 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6d337f64-7473-4590-8d07-d0b7de2a4aa6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:15.164441 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d337f64-7473-4590-8d07-d0b7de2a4aa6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:15.167169 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d337f64-7473-4590-8d07-d0b7de2a4aa6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.168182 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d337f64-7473-4590-8d07-d0b7de2a4aa6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:15.178572 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d337f64-7473-4590-8d07-d0b7de2a4aa6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.360470 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0935f78b-94f8-4f88-bbb4-063060e5fcb3 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:15.382105 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0935f78b-94f8-4f88-bbb4-063060e5fcb3 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.629364 Oct 28 08:41:15.385082 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 138/267] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:14 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:16.151470 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-64c8c381-cbda-4e20-9ff1-2d369ed92712 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:16.152130 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-64c8c381-cbda-4e20-9ff1-2d369ed92712 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:16.165050 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64c8c381-cbda-4e20-9ff1-2d369ed92712 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:16.165491 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64c8c381-cbda-4e20-9ff1-2d369ed92712 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:16.166307 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64c8c381-cbda-4e20-9ff1-2d369ed92712 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:16.172277 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64c8c381-cbda-4e20-9ff1-2d369ed92712 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:16.471892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-64c8c381-cbda-4e20-9ff1-2d369ed92712 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:16.482540 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-64c8c381-cbda-4e20-9ff1-2d369ed92712 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.335046 Oct 28 08:41:16.498950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 139/268] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:16 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:16.514132 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b5d7917d-444c-4caf-8b81-2d89d0c6765b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:16.515782 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b5d7917d-444c-4caf-8b81-2d89d0c6765b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:16.527239 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5d7917d-444c-4caf-8b81-2d89d0c6765b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:16.527964 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5d7917d-444c-4caf-8b81-2d89d0c6765b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:16.528984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5d7917d-444c-4caf-8b81-2d89d0c6765b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:16.529620 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5d7917d-444c-4caf-8b81-2d89d0c6765b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:17.008361 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b5d7917d-444c-4caf-8b81-2d89d0c6765b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:17.023962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b5d7917d-444c-4caf-8b81-2d89d0c6765b tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.523144 Oct 28 08:41:17.025021 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 140/269] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:16 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:17.518107 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-52de9c30-c448-4229-bcc6-1c373df7875e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:17.519692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-52de9c30-c448-4229-bcc6-1c373df7875e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:17.531642 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52de9c30-c448-4229-bcc6-1c373df7875e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:17.535932 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52de9c30-c448-4229-bcc6-1c373df7875e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:17.540430 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52de9c30-c448-4229-bcc6-1c373df7875e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:17.541890 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52de9c30-c448-4229-bcc6-1c373df7875e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:17.955934 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-52de9c30-c448-4229-bcc6-1c373df7875e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:17.972046 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-52de9c30-c448-4229-bcc6-1c373df7875e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.458287 Oct 28 08:41:17.972644 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 141/270] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:17 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:18.042114 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-25ee2fa0-9e6c-413b-b785-7b91b45b9062 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:18.043741 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-25ee2fa0-9e6c-413b-b785-7b91b45b9062 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:18.065402 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-25ee2fa0-9e6c-413b-b785-7b91b45b9062 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.069574 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-25ee2fa0-9e6c-413b-b785-7b91b45b9062 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.073714 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-25ee2fa0-9e6c-413b-b785-7b91b45b9062 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.074613 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-25ee2fa0-9e6c-413b-b785-7b91b45b9062 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.310738 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-25ee2fa0-9e6c-413b-b785-7b91b45b9062 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:18.320027 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-25ee2fa0-9e6c-413b-b785-7b91b45b9062 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.282466 Oct 28 08:41:18.321416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 142/271] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:18 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:18.992056 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0ccb492c-c554-4938-953c-56668f2c7a41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:18.992817 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0ccb492c-c554-4938-953c-56668f2c7a41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:19.009942 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ccb492c-c554-4938-953c-56668f2c7a41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:19.012396 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ccb492c-c554-4938-953c-56668f2c7a41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:19.016244 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ccb492c-c554-4938-953c-56668f2c7a41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:19.017382 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ccb492c-c554-4938-953c-56668f2c7a41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:19.455051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0ccb492c-c554-4938-953c-56668f2c7a41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:19.469753 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0ccb492c-c554-4938-953c-56668f2c7a41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.483184 Oct 28 08:41:19.476315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 143/272] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:18 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:19.481181 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2a1c4965-e57c-42bd-9f8d-68486f16d0c1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:19.488823 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2a1c4965-e57c-42bd-9f8d-68486f16d0c1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:19.499532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2a1c4965-e57c-42bd-9f8d-68486f16d0c1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:19.505099 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2a1c4965-e57c-42bd-9f8d-68486f16d0c1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:19.506771 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2a1c4965-e57c-42bd-9f8d-68486f16d0c1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:19.507322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2a1c4965-e57c-42bd-9f8d-68486f16d0c1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:19.747587 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2a1c4965-e57c-42bd-9f8d-68486f16d0c1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:19.756728 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2a1c4965-e57c-42bd-9f8d-68486f16d0c1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.279062 Oct 28 08:41:19.757957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 144/273] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:19 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:20.491994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ae1ffc88-5221-4793-8fd5-376e05c26374 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:20.492742 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ae1ffc88-5221-4793-8fd5-376e05c26374 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:20.505647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae1ffc88-5221-4793-8fd5-376e05c26374 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:20.507994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae1ffc88-5221-4793-8fd5-376e05c26374 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:20.509268 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae1ffc88-5221-4793-8fd5-376e05c26374 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:20.514551 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae1ffc88-5221-4793-8fd5-376e05c26374 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:20.726726 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6d337f64-7473-4590-8d07-d0b7de2a4aa6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 5.587206 Oct 28 08:41:20.730080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 130/274] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:15 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 5592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:20.777123 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-12ccd4ec-c237-4a4c-9c7d-9c6d7602daff tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:20.778093 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-12ccd4ec-c237-4a4c-9c7d-9c6d7602daff tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:20.800894 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-12ccd4ec-c237-4a4c-9c7d-9c6d7602daff tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:20.814636 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-12ccd4ec-c237-4a4c-9c7d-9c6d7602daff tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:20.819600 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-12ccd4ec-c237-4a4c-9c7d-9c6d7602daff tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:20.823010 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-12ccd4ec-c237-4a4c-9c7d-9c6d7602daff tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.144315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ae1ffc88-5221-4793-8fd5-376e05c26374 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:21.164077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ae1ffc88-5221-4793-8fd5-376e05c26374 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.680632 Oct 28 08:41:21.165096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 145/275] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:20 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:21.354314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-12ccd4ec-c237-4a4c-9c7d-9c6d7602daff tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:21.365917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-12ccd4ec-c237-4a4c-9c7d-9c6d7602daff tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.594208 Oct 28 08:41:21.368552 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 131/276] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:20 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:21.742772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-425ff0bf-c480-447d-9de1-ea9325252bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:21.744016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-425ff0bf-c480-447d-9de1-ea9325252bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:21.767514 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-425ff0bf-c480-447d-9de1-ea9325252bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:21.768278 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-425ff0bf-c480-447d-9de1-ea9325252bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.770752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-425ff0bf-c480-447d-9de1-ea9325252bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:21.771499 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-425ff0bf-c480-447d-9de1-ea9325252bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.963647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-425ff0bf-c480-447d-9de1-ea9325252bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.226422 Oct 28 08:41:21.968558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 146/277] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:21 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:22.185093 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-aac9b5f8-1680-4cdb-968e-0684b7eaa62d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:22.186470 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-aac9b5f8-1680-4cdb-968e-0684b7eaa62d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:22.200283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aac9b5f8-1680-4cdb-968e-0684b7eaa62d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.200954 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aac9b5f8-1680-4cdb-968e-0684b7eaa62d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.203037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aac9b5f8-1680-4cdb-968e-0684b7eaa62d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.203753 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aac9b5f8-1680-4cdb-968e-0684b7eaa62d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.385342 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2883882f-1838-4097-92f5-0004a175748f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:22.386260 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2883882f-1838-4097-92f5-0004a175748f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:22.407557 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2883882f-1838-4097-92f5-0004a175748f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.426850 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2883882f-1838-4097-92f5-0004a175748f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.427711 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2883882f-1838-4097-92f5-0004a175748f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.428159 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2883882f-1838-4097-92f5-0004a175748f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.751354 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-aac9b5f8-1680-4cdb-968e-0684b7eaa62d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:22.762846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-aac9b5f8-1680-4cdb-968e-0684b7eaa62d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1518 microversion: 2.1 time: 0.582741 Oct 28 08:41:22.764563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 132/278] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:22 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1518 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:22.858772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2883882f-1838-4097-92f5-0004a175748f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:22.872684 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2883882f-1838-4097-92f5-0004a175748f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.491664 Oct 28 08:41:22.873686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 147/279] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:22 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:22.979120 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7307e649-1a27-4c80-803b-cfc50c8d09b4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:22.980258 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7307e649-1a27-4c80-803b-cfc50c8d09b4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:22.988486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7307e649-1a27-4c80-803b-cfc50c8d09b4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.992358 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7307e649-1a27-4c80-803b-cfc50c8d09b4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.996773 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7307e649-1a27-4c80-803b-cfc50c8d09b4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.997385 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7307e649-1a27-4c80-803b-cfc50c8d09b4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:23.021706 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-528da4b9-f623-4b6c-b420-2d1443ee59de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'create', calling method: .version_select at 0x7f9e7822ff70>, body: {"keypair": {"name": "tempest-keypair-725916061"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:23.058340 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-528da4b9-f623-4b6c-b420-2d1443ee59de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'key_pairs'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:23.068313 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-528da4b9-f623-4b6c-b420-2d1443ee59de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for user c8ccd80f4552487583ff9076adab3b25 and project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'key_pairs'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:23.074053 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7307e649-1a27-4c80-803b-cfc50c8d09b4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.102046 Oct 28 08:41:23.079003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 148/280] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:22 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:23.783563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c08ef21b-a8cd-4c60-b37f-57ea19b751ea tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:23.784951 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c08ef21b-a8cd-4c60-b37f-57ea19b751ea tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:23.803898 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c08ef21b-a8cd-4c60-b37f-57ea19b751ea tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:23.804542 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c08ef21b-a8cd-4c60-b37f-57ea19b751ea tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:23.806819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c08ef21b-a8cd-4c60-b37f-57ea19b751ea tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:23.808378 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c08ef21b-a8cd-4c60-b37f-57ea19b751ea tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:23.911784 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-528da4b9-f623-4b6c-b420-2d1443ee59de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'key_pairs'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:23.936989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-528da4b9-f623-4b6c-b420-2d1443ee59de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for user c8ccd80f4552487583ff9076adab3b25 and project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'key_pairs'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:23.971636 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-528da4b9-f623-4b6c-b420-2d1443ee59de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.204828 Oct 28 08:41:23.972559 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 133/281] 10.222.0.74 () {62 vars in 1198 bytes} [Thu Oct 28 08:41:22 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1206 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:41:23.991774 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c8c30b4d-d07f-426e-ae89-f74b35f501dd tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:23.993248 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c8c30b4d-d07f-426e-ae89-f74b35f501dd tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:24.012884 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c8c30b4d-d07f-426e-ae89-f74b35f501dd tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.014731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c8c30b4d-d07f-426e-ae89-f74b35f501dd tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.016767 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c8c30b4d-d07f-426e-ae89-f74b35f501dd tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.018647 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c8c30b4d-d07f-426e-ae89-f74b35f501dd tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.216300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c08ef21b-a8cd-4c60-b37f-57ea19b751ea tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:24.229340 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c08ef21b-a8cd-4c60-b37f-57ea19b751ea tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1498 microversion: 2.1 time: 0.447308 Oct 28 08:41:24.231697 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 149/282] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:23 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1498 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:24.243035 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-7f74d0c2-d3d6-4806-baee-48c73a87080f req-98fe62d5-e3e4-4965-adec-d8e68afe0e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01160f21-7cfb-4fd7-99fa-f9d7fa21acd5", "name": "network-vif-plugged", "status": "completed", "tag": "df7df76e-bd7c-4f8c-93e3-b04d53cccf2e"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:24.247569 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:24.247569 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:41:24.271747 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-7f74d0c2-d3d6-4806-baee-48c73a87080f req-98fe62d5-e3e4-4965-adec-d8e68afe0e67 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.273570 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-7f74d0c2-d3d6-4806-baee-48c73a87080f req-98fe62d5-e3e4-4965-adec-d8e68afe0e67 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.333599 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-7f74d0c2-d3d6-4806-baee-48c73a87080f req-98fe62d5-e3e4-4965-adec-d8e68afe0e67 service nova] Creating event network-vif-plugged:df7df76e-bd7c-4f8c-93e3-b04d53cccf2e for instance 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 on hv-cinder-81566 Oct 28 08:41:24.358173 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-7f74d0c2-d3d6-4806-baee-48c73a87080f req-98fe62d5-e3e4-4965-adec-d8e68afe0e67 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124646 Oct 28 08:41:24.362889 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 150/283] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:24.397682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c6611dd3-bfe2-438f-a584-8a98e481b81f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:24.400363 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c6611dd3-bfe2-438f-a584-8a98e481b81f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:24.422706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6611dd3-bfe2-438f-a584-8a98e481b81f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.423307 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6611dd3-bfe2-438f-a584-8a98e481b81f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.427836 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6611dd3-bfe2-438f-a584-8a98e481b81f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.428597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6611dd3-bfe2-438f-a584-8a98e481b81f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.515873 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c8c30b4d-d07f-426e-ae89-f74b35f501dd tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:24.529969 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c8c30b4d-d07f-426e-ae89-f74b35f501dd tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.549706 Oct 28 08:41:24.530759 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 134/284] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:23 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:24.543636 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e81a8594-7cb6-40ee-83ff-0239c927ec0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:24.545628 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e81a8594-7cb6-40ee-83ff-0239c927ec0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:24.574370 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e81a8594-7cb6-40ee-83ff-0239c927ec0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.576515 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e81a8594-7cb6-40ee-83ff-0239c927ec0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.577691 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e81a8594-7cb6-40ee-83ff-0239c927ec0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.581204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e81a8594-7cb6-40ee-83ff-0239c927ec0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.584391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c6611dd3-bfe2-438f-a584-8a98e481b81f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.219288 Oct 28 08:41:24.588633 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 151/285] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:24 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:25.104820 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e81a8594-7cb6-40ee-83ff-0239c927ec0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:25.135129 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e81a8594-7cb6-40ee-83ff-0239c927ec0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1514 microversion: 2.1 time: 0.592808 Oct 28 08:41:25.137161 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 135/286] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:24 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1514 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:25.552051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-65a7f292-0042-4613-9b5e-bf7bd5713a32 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:25.553646 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-65a7f292-0042-4613-9b5e-bf7bd5713a32 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:25.565586 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65a7f292-0042-4613-9b5e-bf7bd5713a32 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.567129 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65a7f292-0042-4613-9b5e-bf7bd5713a32 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.568787 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65a7f292-0042-4613-9b5e-bf7bd5713a32 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.569387 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65a7f292-0042-4613-9b5e-bf7bd5713a32 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.601392 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4d8acd93-973d-4a90-bffe-0753216a144e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:25.602885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4d8acd93-973d-4a90-bffe-0753216a144e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:25.616803 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4d8acd93-973d-4a90-bffe-0753216a144e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.617545 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4d8acd93-973d-4a90-bffe-0753216a144e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.621971 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4d8acd93-973d-4a90-bffe-0753216a144e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.625167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4d8acd93-973d-4a90-bffe-0753216a144e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.816058 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4d8acd93-973d-4a90-bffe-0753216a144e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.219189 Oct 28 08:41:25.816827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 136/287] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:25 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:26.096534 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-65a7f292-0042-4613-9b5e-bf7bd5713a32 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:26.117884 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-65a7f292-0042-4613-9b5e-bf7bd5713a32 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1314 microversion: 2.1 time: 0.572503 Oct 28 08:41:26.118882 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 152/288] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:25 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:26.828950 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-064f6bb5-75f5-4cdd-bee9-2a276a9b5688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:26.829992 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-064f6bb5-75f5-4cdd-bee9-2a276a9b5688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:26.854896 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-064f6bb5-75f5-4cdd-bee9-2a276a9b5688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.858746 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-064f6bb5-75f5-4cdd-bee9-2a276a9b5688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.859878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-064f6bb5-75f5-4cdd-bee9-2a276a9b5688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.860518 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-064f6bb5-75f5-4cdd-bee9-2a276a9b5688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.950565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-064f6bb5-75f5-4cdd-bee9-2a276a9b5688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.122999 Oct 28 08:41:26.957952 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 137/289] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:26 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:27.043149 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5c213537-043c-45b1-b0a0-7f51e1cf7dd0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:27.044079 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5c213537-043c-45b1-b0a0-7f51e1cf7dd0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:27.057150 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5c213537-043c-45b1-b0a0-7f51e1cf7dd0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.073768 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5c213537-043c-45b1-b0a0-7f51e1cf7dd0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.078073 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5c213537-043c-45b1-b0a0-7f51e1cf7dd0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.079109 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5c213537-043c-45b1-b0a0-7f51e1cf7dd0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.138059 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f63d0290-9387-40df-9b60-70e6cef63687 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:27.139060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f63d0290-9387-40df-9b60-70e6cef63687 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:27.175078 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f63d0290-9387-40df-9b60-70e6cef63687 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.179978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f63d0290-9387-40df-9b60-70e6cef63687 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.183243 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f63d0290-9387-40df-9b60-70e6cef63687 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.183868 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f63d0290-9387-40df-9b60-70e6cef63687 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.194426 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.objects.instance [None req-5c213537-043c-45b1-b0a0-7f51e1cf7dd0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lazy-loading 'flavor' on Instance uuid c70c146b-a5ed-43af-aad8-18fb35f2dab5 {{(pid=132796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:41:27.434001 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5c213537-043c-45b1-b0a0-7f51e1cf7dd0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/action" status: 200 len: 32 microversion: 2.1 time: 0.394761 Oct 28 08:41:27.453451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 153/290] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:27 2021] POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/action => generated 32 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:27.466334 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ae16fba5-fa66-468d-bf1b-914bca1e2090 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:27.468296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ae16fba5-fa66-468d-bf1b-914bca1e2090 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:27.478788 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae16fba5-fa66-468d-bf1b-914bca1e2090 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.479719 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae16fba5-fa66-468d-bf1b-914bca1e2090 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.481030 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae16fba5-fa66-468d-bf1b-914bca1e2090 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.482499 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae16fba5-fa66-468d-bf1b-914bca1e2090 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.708198 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f63d0290-9387-40df-9b60-70e6cef63687 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:27.744358 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f63d0290-9387-40df-9b60-70e6cef63687 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1498 microversion: 2.1 time: 0.599542 Oct 28 08:41:27.762485 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 138/291] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:27 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1498 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:27.963048 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ea7acedf-62c0-49d5-b996-3b23cc920984 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:27.964980 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ea7acedf-62c0-49d5-b996-3b23cc920984 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:27.977891 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ea7acedf-62c0-49d5-b996-3b23cc920984 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.981514 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ea7acedf-62c0-49d5-b996-3b23cc920984 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.983979 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ea7acedf-62c0-49d5-b996-3b23cc920984 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.984926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ea7acedf-62c0-49d5-b996-3b23cc920984 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.031509 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ae16fba5-fa66-468d-bf1b-914bca1e2090 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:28.059868 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ae16fba5-fa66-468d-bf1b-914bca1e2090 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.604017 Oct 28 08:41:28.065584 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 154/292] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:27 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:28.078816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ea7acedf-62c0-49d5-b996-3b23cc920984 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.119309 Oct 28 08:41:28.084474 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 139/293] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:27 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:28.663392 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-988262770", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1bb7b256-4baa-432c-addc-978134812fe5"}], "security_groups": [{"name": "tempest-securitygroup--395849367"}], "key_name": "tempest-keypair-725916061", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:28.733460 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a851c360-41e8-4e0b-8c4a-3dbbe995ec2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:28.734430 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a851c360-41e8-4e0b-8c4a-3dbbe995ec2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:28.747605 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a851c360-41e8-4e0b-8c4a-3dbbe995ec2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.748373 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a851c360-41e8-4e0b-8c4a-3dbbe995ec2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.768473 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a851c360-41e8-4e0b-8c4a-3dbbe995ec2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.771608 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a851c360-41e8-4e0b-8c4a-3dbbe995ec2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.809519 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a851c360-41e8-4e0b-8c4a-3dbbe995ec2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Going to try to terminate instance {{(pid=132797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:41:28.932224 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] validate_networks() for [('1bb7b256-4baa-432c-addc-978134812fe5', None, None, None, None, None)] {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:41:28.960707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a851c360-41e8-4e0b-8c4a-3dbbe995ec2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "DELETE /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 204 len: 0 microversion: 2.1 time: 0.234670 Oct 28 08:41:28.961753 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 140/294] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:41:28 2021] DELETE /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:41:28.971013 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-10a01106-f188-40dd-b1b6-af4f9b23e3ca tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:28.971718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-10a01106-f188-40dd-b1b6-af4f9b23e3ca tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:28.984207 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10a01106-f188-40dd-b1b6-af4f9b23e3ca tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.994867 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10a01106-f188-40dd-b1b6-af4f9b23e3ca tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.997562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10a01106-f188-40dd-b1b6-af4f9b23e3ca tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.998329 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10a01106-f188-40dd-b1b6-af4f9b23e3ca tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.359951 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-10a01106-f188-40dd-b1b6-af4f9b23e3ca tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:29.374272 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-10a01106-f188-40dd-b1b6-af4f9b23e3ca tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1504 microversion: 2.1 time: 0.407997 Oct 28 08:41:29.390215 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 141/295] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:28 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:29.398823 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-91946292-4b38-400a-8886-3e1604cf7fcf tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:29.402030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-91946292-4b38-400a-8886-3e1604cf7fcf tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:29.421935 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-91946292-4b38-400a-8886-3e1604cf7fcf tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.427220 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-91946292-4b38-400a-8886-3e1604cf7fcf tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.428379 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-91946292-4b38-400a-8886-3e1604cf7fcf tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.429019 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-91946292-4b38-400a-8886-3e1604cf7fcf tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.745394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-91946292-4b38-400a-8886-3e1604cf7fcf tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:29.755869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-91946292-4b38-400a-8886-3e1604cf7fcf tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.361791 Oct 28 08:41:29.756698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 142/296] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:29 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:29.759410 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:41:29.760340 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:41:29.760942 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:41:29.761473 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:41:29.762116 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:41:29.765563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3f798499-2ecc-48e9-bd0a-5483a1d5384e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:29.771030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3f798499-2ecc-48e9-bd0a-5483a1d5384e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:29.773423 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.773905 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.774717 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.775340 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.786075 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f798499-2ecc-48e9-bd0a-5483a1d5384e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.787908 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f798499-2ecc-48e9-bd0a-5483a1d5384e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.790499 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f798499-2ecc-48e9-bd0a-5483a1d5384e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.792211 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f798499-2ecc-48e9-bd0a-5483a1d5384e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.797289 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:29.804712 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for user c8ccd80f4552487583ff9076adab3b25 and project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:29.822625 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:41:29.841082 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:41:29.906476 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3f798499-2ecc-48e9-bd0a-5483a1d5384e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.148168 Oct 28 08:41:29.908209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 143/297] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:29 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:29.915048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-05c22772-e50f-464d-af1c-9f7ce6e83d7e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.257532 Oct 28 08:41:29.917270 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 155/298] 10.222.0.74 () {62 vars in 1187 bytes} [Thu Oct 28 08:41:28 2021] POST /compute/v2.1/servers => generated 401 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 08:41:29.928861 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b06875d5-e53f-4760-86f5-49d6e438f238 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:29.930075 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b06875d5-e53f-4760-86f5-49d6e438f238 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:30.071924 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b06875d5-e53f-4760-86f5-49d6e438f238 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:30.083481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b06875d5-e53f-4760-86f5-49d6e438f238 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:30.086793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b06875d5-e53f-4760-86f5-49d6e438f238 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:30.091547 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b06875d5-e53f-4760-86f5-49d6e438f238 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1280 microversion: 2.20 time: 0.167826 Oct 28 08:41:30.092065 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 144/299] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:29 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:30.401243 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4b4de00a-0cfc-4954-acd6-6b8db1734a1f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:30.402020 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4b4de00a-0cfc-4954-acd6-6b8db1734a1f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:30.412425 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b4de00a-0cfc-4954-acd6-6b8db1734a1f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.415243 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b4de00a-0cfc-4954-acd6-6b8db1734a1f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.416159 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b4de00a-0cfc-4954-acd6-6b8db1734a1f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.417682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b4de00a-0cfc-4954-acd6-6b8db1734a1f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.777749 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b5b2db1b-4adc-455d-9e2f-874f46c32ee4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:30.778871 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b5b2db1b-4adc-455d-9e2f-874f46c32ee4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:30.780051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4b4de00a-0cfc-4954-acd6-6b8db1734a1f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:30.791970 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b5b2db1b-4adc-455d-9e2f-874f46c32ee4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.792938 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b5b2db1b-4adc-455d-9e2f-874f46c32ee4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.794954 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4b4de00a-0cfc-4954-acd6-6b8db1734a1f tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1504 microversion: 2.1 time: 0.399201 Oct 28 08:41:30.796356 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b5b2db1b-4adc-455d-9e2f-874f46c32ee4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.797015 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b5b2db1b-4adc-455d-9e2f-874f46c32ee4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.797395 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 156/300] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:30 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:30.918122 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d238e2c6-bf05-4712-ab10-50d663e5cf34 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:30.919653 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d238e2c6-bf05-4712-ab10-50d663e5cf34 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:30.934065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d238e2c6-bf05-4712-ab10-50d663e5cf34 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.934810 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d238e2c6-bf05-4712-ab10-50d663e5cf34 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.936363 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d238e2c6-bf05-4712-ab10-50d663e5cf34 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.936984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d238e2c6-bf05-4712-ab10-50d663e5cf34 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.197772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d238e2c6-bf05-4712-ab10-50d663e5cf34 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.282828 Oct 28 08:41:31.198359 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 157/301] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:30 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:31.202846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b5b2db1b-4adc-455d-9e2f-874f46c32ee4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:31.203397 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8f8bc55d-20ed-433b-afba-01e09e9465be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:31.203971 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8f8bc55d-20ed-433b-afba-01e09e9465be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:31.212387 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b5b2db1b-4adc-455d-9e2f-874f46c32ee4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.439994 Oct 28 08:41:31.225588 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 145/302] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:30 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:31.225901 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8f8bc55d-20ed-433b-afba-01e09e9465be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.225901 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8f8bc55d-20ed-433b-afba-01e09e9465be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.225901 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8f8bc55d-20ed-433b-afba-01e09e9465be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.225901 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8f8bc55d-20ed-433b-afba-01e09e9465be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.430754 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8f8bc55d-20ed-433b-afba-01e09e9465be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:31.446488 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8f8bc55d-20ed-433b-afba-01e09e9465be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:31.448454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8f8bc55d-20ed-433b-afba-01e09e9465be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:31.453090 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8f8bc55d-20ed-433b-afba-01e09e9465be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1332 microversion: 2.20 time: 0.253680 Oct 28 08:41:31.456076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 158/303] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:31 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1332 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:31.813989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5cf50428-4b50-40ee-8066-f589988dc5fc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:31.814797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5cf50428-4b50-40ee-8066-f589988dc5fc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:31.829618 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5cf50428-4b50-40ee-8066-f589988dc5fc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.830132 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5cf50428-4b50-40ee-8066-f589988dc5fc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.835042 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5cf50428-4b50-40ee-8066-f589988dc5fc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.835940 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5cf50428-4b50-40ee-8066-f589988dc5fc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.216352 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a9e2add2-154a-4cd6-93eb-96f463510173 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:32.217916 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a9e2add2-154a-4cd6-93eb-96f463510173 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:32.235767 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a9e2add2-154a-4cd6-93eb-96f463510173 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.236429 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a9e2add2-154a-4cd6-93eb-96f463510173 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.237382 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a9e2add2-154a-4cd6-93eb-96f463510173 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.241135 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a9e2add2-154a-4cd6-93eb-96f463510173 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.372853 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a9e2add2-154a-4cd6-93eb-96f463510173 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.167150 Oct 28 08:41:32.373998 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 159/304] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:32 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:32.392834 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-82f855df-3458-4378-b03e-a7833c6814c6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:32.397080 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-82f855df-3458-4378-b03e-a7833c6814c6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:32.428233 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-82f855df-3458-4378-b03e-a7833c6814c6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.429002 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-82f855df-3458-4378-b03e-a7833c6814c6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.431060 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-82f855df-3458-4378-b03e-a7833c6814c6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.431761 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-82f855df-3458-4378-b03e-a7833c6814c6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.556777 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5cf50428-4b50-40ee-8066-f589988dc5fc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:32.568456 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5cf50428-4b50-40ee-8066-f589988dc5fc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1504 microversion: 2.1 time: 0.757165 Oct 28 08:41:32.570522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 146/305] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:31 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1504 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:32.579521 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-76293d18-b0b4-4b95-aad3-f3fceb0acd40 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:32.584717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-76293d18-b0b4-4b95-aad3-f3fceb0acd40 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:32.611883 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76293d18-b0b4-4b95-aad3-f3fceb0acd40 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.617647 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76293d18-b0b4-4b95-aad3-f3fceb0acd40 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.618723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76293d18-b0b4-4b95-aad3-f3fceb0acd40 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.620286 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-76293d18-b0b4-4b95-aad3-f3fceb0acd40 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.922552 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-76293d18-b0b4-4b95-aad3-f3fceb0acd40 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:32.933148 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-76293d18-b0b4-4b95-aad3-f3fceb0acd40 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:32.934705 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-76293d18-b0b4-4b95-aad3-f3fceb0acd40 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:32.943501 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-76293d18-b0b4-4b95-aad3-f3fceb0acd40 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1338 microversion: 2.20 time: 0.371826 Oct 28 08:41:32.954797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 147/306] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:32 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1338 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:33.231567 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-7ad1a68f-e51a-4f68-a2de-ca5b6c4fcbff req-848d49c2-9eb8-4356-9695-8d6347fc8150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01160f21-7cfb-4fd7-99fa-f9d7fa21acd5", "name": "network-vif-deleted", "tag": "df7df76e-bd7c-4f8c-93e3-b04d53cccf2e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:33.233298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:33.233298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:41:33.243455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-82f855df-3458-4378-b03e-a7833c6814c6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:33.246084 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-7ad1a68f-e51a-4f68-a2de-ca5b6c4fcbff req-848d49c2-9eb8-4356-9695-8d6347fc8150 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.246528 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-7ad1a68f-e51a-4f68-a2de-ca5b6c4fcbff req-848d49c2-9eb8-4356-9695-8d6347fc8150 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.255895 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-82f855df-3458-4378-b03e-a7833c6814c6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.880231 Oct 28 08:41:33.270266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 160/307] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:32 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:33.280860 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-7ad1a68f-e51a-4f68-a2de-ca5b6c4fcbff req-848d49c2-9eb8-4356-9695-8d6347fc8150 service nova] Creating event network-vif-deleted:df7df76e-bd7c-4f8c-93e3-b04d53cccf2e for instance 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 on hv-cinder-81566 Oct 28 08:41:33.286762 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-7ad1a68f-e51a-4f68-a2de-ca5b6c4fcbff req-848d49c2-9eb8-4356-9695-8d6347fc8150 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061258 Oct 28 08:41:33.287840 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 148/308] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:41:33.395723 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a5937463-6e0d-4846-8977-b95034089c08 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:33.396654 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a5937463-6e0d-4846-8977-b95034089c08 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:33.413528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a5937463-6e0d-4846-8977-b95034089c08 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.417216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a5937463-6e0d-4846-8977-b95034089c08 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.418402 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a5937463-6e0d-4846-8977-b95034089c08 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.419486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a5937463-6e0d-4846-8977-b95034089c08 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.531701 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a5937463-6e0d-4846-8977-b95034089c08 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.142985 Oct 28 08:41:33.533175 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 161/309] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:33 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:33.589633 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:33.590361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:33.603551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.608727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.609558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.610024 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.720111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.720563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.721023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lazy-loading 'fault' on Instance uuid 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:41:33.978637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-54c49fed-55c7-4f2d-aa19-9dbd56e0c11e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:33.980881 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-54c49fed-55c7-4f2d-aa19-9dbd56e0c11e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:34.013073 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54c49fed-55c7-4f2d-aa19-9dbd56e0c11e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.014098 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54c49fed-55c7-4f2d-aa19-9dbd56e0c11e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.028288 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54c49fed-55c7-4f2d-aa19-9dbd56e0c11e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.029094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54c49fed-55c7-4f2d-aa19-9dbd56e0c11e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.191492 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:34.204272 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0e2fd668-d4b8-44c1-a472-529a4d890d2a tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 200 len: 1304 microversion: 2.1 time: 0.619448 Oct 28 08:41:34.205209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 149/310] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:33 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 1304 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:34.273297 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-eb578610-69b5-4f51-80d2-652be2f5ecff tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:34.273933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-eb578610-69b5-4f51-80d2-652be2f5ecff tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:34.291345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb578610-69b5-4f51-80d2-652be2f5ecff tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.292071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb578610-69b5-4f51-80d2-652be2f5ecff tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.293008 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb578610-69b5-4f51-80d2-652be2f5ecff tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.293599 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb578610-69b5-4f51-80d2-652be2f5ecff tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.547243 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-54c49fed-55c7-4f2d-aa19-9dbd56e0c11e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:34.565054 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-54c49fed-55c7-4f2d-aa19-9dbd56e0c11e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:34.567409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-54c49fed-55c7-4f2d-aa19-9dbd56e0c11e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:34.569322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-54c49fed-55c7-4f2d-aa19-9dbd56e0c11e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.610506 Oct 28 08:41:34.590057 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 162/311] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:33 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:34.595095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e1ab1a8e-fbc4-47e5-8ae2-38dd35a74b35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:34.596264 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e1ab1a8e-fbc4-47e5-8ae2-38dd35a74b35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:34.605885 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1ab1a8e-fbc4-47e5-8ae2-38dd35a74b35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.610926 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1ab1a8e-fbc4-47e5-8ae2-38dd35a74b35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.615461 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1ab1a8e-fbc4-47e5-8ae2-38dd35a74b35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.616142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1ab1a8e-fbc4-47e5-8ae2-38dd35a74b35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.728756 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e1ab1a8e-fbc4-47e5-8ae2-38dd35a74b35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.137091 Oct 28 08:41:34.729957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 163/312] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:34 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:34.731660 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-eb578610-69b5-4f51-80d2-652be2f5ecff tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:34.742013 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-eb578610-69b5-4f51-80d2-652be2f5ecff tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.473292 Oct 28 08:41:34.752067 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 150/313] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:34 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:35.155065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-e1f9c841-b500-42dd-9e98-335606f469b4 req-c70717b8-fb75-4fa0-988f-9e49a0c615bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423157c3-a1e9-43c5-8fda-01d1d93bd484", "tag": "2e8c6f82-a258-4342-aacf-0b4e80ccd12e"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:35.156577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:35.156577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:41:35.175611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-e1f9c841-b500-42dd-9e98-335606f469b4 req-c70717b8-fb75-4fa0-988f-9e49a0c615bc service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.176882 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-e1f9c841-b500-42dd-9e98-335606f469b4 req-c70717b8-fb75-4fa0-988f-9e49a0c615bc service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:35.223656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-df363cd3-9bb5-4d13-a90c-c820642ab22c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:35.224268 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-df363cd3-9bb5-4d13-a90c-c820642ab22c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:35.231729 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-e1f9c841-b500-42dd-9e98-335606f469b4 req-c70717b8-fb75-4fa0-988f-9e49a0c615bc service nova] Creating event network-changed:2e8c6f82-a258-4342-aacf-0b4e80ccd12e for instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 on hv-cinder-81566 Oct 28 08:41:35.235357 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-df363cd3-9bb5-4d13-a90c-c820642ab22c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.235990 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-df363cd3-9bb5-4d13-a90c-c820642ab22c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:35.236945 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-df363cd3-9bb5-4d13-a90c-c820642ab22c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.240267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-df363cd3-9bb5-4d13-a90c-c820642ab22c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:35.260082 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-e1f9c841-b500-42dd-9e98-335606f469b4 req-c70717b8-fb75-4fa0-988f-9e49a0c615bc service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108775 Oct 28 08:41:35.269625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-df363cd3-9bb5-4d13-a90c-c820642ab22c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] HTTP exception thrown: Instance 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 could not be found. Oct 28 08:41:35.271503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 164/314] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:35.278220 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-df363cd3-9bb5-4d13-a90c-c820642ab22c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Returning 404 to user: Instance 01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:35.279348 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-df363cd3-9bb5-4d13-a90c-c820642ab22c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5" status: 404 len: 111 microversion: 2.1 time: 0.059657 Oct 28 08:41:35.280851 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 151/315] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:35 2021] GET /compute/v2.1/servers/01160f21-7cfb-4fd7-99fa-f9d7fa21acd5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:41:35.597855 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-72d5593d-500f-4d0d-9954-6976fb8286cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:35.598824 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-72d5593d-500f-4d0d-9954-6976fb8286cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:35.619953 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-72d5593d-500f-4d0d-9954-6976fb8286cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.620947 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-72d5593d-500f-4d0d-9954-6976fb8286cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:35.627596 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-72d5593d-500f-4d0d-9954-6976fb8286cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.627596 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-72d5593d-500f-4d0d-9954-6976fb8286cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:35.639529 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1868514615", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "networks": [{"uuid": "8e42fbac-77c0-47d1-ade7-e20b3e0f64ea"}]}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:35.753200 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.network.neutron [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] validate_networks() for [('8e42fbac-77c0-47d1-ade7-e20b3e0f64ea', None, None, None, None, None)] {{(pid=132797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:41:36.036653 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-72d5593d-500f-4d0d-9954-6976fb8286cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:36.059413 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-72d5593d-500f-4d0d-9954-6976fb8286cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:36.065051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-72d5593d-500f-4d0d-9954-6976fb8286cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:36.067710 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-72d5593d-500f-4d0d-9954-6976fb8286cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.475881 Oct 28 08:41:36.069417 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 165/316] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:35 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:36.087547 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-075ef8c1-0759-41cd-9e10-762bb31839ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:36.089858 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-075ef8c1-0759-41cd-9e10-762bb31839ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:36.111470 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-075ef8c1-0759-41cd-9e10-762bb31839ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.112399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-075ef8c1-0759-41cd-9e10-762bb31839ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.113557 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-075ef8c1-0759-41cd-9e10-762bb31839ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.114981 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-075ef8c1-0759-41cd-9e10-762bb31839ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.568706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-075ef8c1-0759-41cd-9e10-762bb31839ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.497610 Oct 28 08:41:36.569353 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 166/317] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:36 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:36.578406 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7ef7280e-74b1-455e-99fe-93df38fc6c4f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:36.585882 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7ef7280e-74b1-455e-99fe-93df38fc6c4f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:36.608486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7ef7280e-74b1-455e-99fe-93df38fc6c4f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.610402 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7ef7280e-74b1-455e-99fe-93df38fc6c4f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.627246 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7ef7280e-74b1-455e-99fe-93df38fc6c4f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.627246 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7ef7280e-74b1-455e-99fe-93df38fc6c4f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.669337 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Flavor limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:41:36.669337 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Image limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:41:36.669337 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Flavor pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:41:36.669337 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Image pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:41:36.669337 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:41:36.683880 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.688076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.689482 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.690170 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.742508 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Getting quotas for project 5524f9a286464e8db7e4cb81c3879647. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:36.754102 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Getting quotas for user be9c2df8ea2c42c3a7e1d313834fc4e9 and project 5524f9a286464e8db7e4cb81c3879647. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:36.782787 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Going to run 1 instances... {{(pid=132797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:41:36.789661 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:41:36.901292 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-107a984e-8239-4eb2-b804-069af86c2edc tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.263649 Oct 28 08:41:36.902425 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 152/318] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:41:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 08:41:36.908544 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7ef7280e-74b1-455e-99fe-93df38fc6c4f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:36.912357 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6e1c6140-0f24-4a92-b9de-f2982323cef8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:36.913045 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6e1c6140-0f24-4a92-b9de-f2982323cef8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:36.920439 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7ef7280e-74b1-455e-99fe-93df38fc6c4f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.348775 Oct 28 08:41:36.922288 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 167/319] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:36 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:37.005707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6e1c6140-0f24-4a92-b9de-f2982323cef8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:37.012933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6e1c6140-0f24-4a92-b9de-f2982323cef8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1214 microversion: 2.1 time: 0.104562 Oct 28 08:41:37.014376 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 153/320] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:36 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:37.091989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-79b76063-ae5e-486e-a9aa-91959238118f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:37.092918 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-79b76063-ae5e-486e-a9aa-91959238118f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:37.115169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-79b76063-ae5e-486e-a9aa-91959238118f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.115855 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-79b76063-ae5e-486e-a9aa-91959238118f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.118248 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-79b76063-ae5e-486e-a9aa-91959238118f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.120127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-79b76063-ae5e-486e-a9aa-91959238118f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.398738 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-79b76063-ae5e-486e-a9aa-91959238118f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:37.410134 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-79b76063-ae5e-486e-a9aa-91959238118f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:37.413124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-79b76063-ae5e-486e-a9aa-91959238118f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:37.414793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-79b76063-ae5e-486e-a9aa-91959238118f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.328669 Oct 28 08:41:37.416286 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 168/321] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:37 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:37.579587 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-986fdbac-5c90-42e0-bdfc-12bf9e46c264 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:37.580662 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-986fdbac-5c90-42e0-bdfc-12bf9e46c264 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:37.601315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-986fdbac-5c90-42e0-bdfc-12bf9e46c264 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.608544 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-986fdbac-5c90-42e0-bdfc-12bf9e46c264 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.609460 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-986fdbac-5c90-42e0-bdfc-12bf9e46c264 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.612697 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-986fdbac-5c90-42e0-bdfc-12bf9e46c264 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.780708 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-986fdbac-5c90-42e0-bdfc-12bf9e46c264 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28224 microversion: 2.1 time: 0.204515 Oct 28 08:41:37.786360 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 154/322] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:37 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28224 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:37.944306 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-05979b99-7cdd-4745-9d8b-c030b3ab8b40 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:37.944914 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-05979b99-7cdd-4745-9d8b-c030b3ab8b40 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:37.956459 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05979b99-7cdd-4745-9d8b-c030b3ab8b40 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.956981 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05979b99-7cdd-4745-9d8b-c030b3ab8b40 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.963627 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05979b99-7cdd-4745-9d8b-c030b3ab8b40 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.964528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-05979b99-7cdd-4745-9d8b-c030b3ab8b40 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.033238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3aa10d5c-ea6c-47bc-9a70-d3d04c01af66 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:38.034622 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3aa10d5c-ea6c-47bc-9a70-d3d04c01af66 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:38.044591 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3aa10d5c-ea6c-47bc-9a70-d3d04c01af66 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.045304 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3aa10d5c-ea6c-47bc-9a70-d3d04c01af66 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.046286 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3aa10d5c-ea6c-47bc-9a70-d3d04c01af66 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.046875 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3aa10d5c-ea6c-47bc-9a70-d3d04c01af66 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.159647 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3aa10d5c-ea6c-47bc-9a70-d3d04c01af66 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:38.171961 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3aa10d5c-ea6c-47bc-9a70-d3d04c01af66 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1266 microversion: 2.1 time: 0.142856 Oct 28 08:41:38.172846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 155/323] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:38 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:38.194215 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-05979b99-7cdd-4745-9d8b-c030b3ab8b40 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:38.206118 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-05979b99-7cdd-4745-9d8b-c030b3ab8b40 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.265830 Oct 28 08:41:38.210182 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 169/324] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:37 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:38.433489 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-79127751-3896-4b65-8e95-4683b7a2873e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:38.434512 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-79127751-3896-4b65-8e95-4683b7a2873e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:38.469730 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79127751-3896-4b65-8e95-4683b7a2873e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.470188 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79127751-3896-4b65-8e95-4683b7a2873e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.470957 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79127751-3896-4b65-8e95-4683b7a2873e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.471383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79127751-3896-4b65-8e95-4683b7a2873e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.781373 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-390885044", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:38.897167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-79127751-3896-4b65-8e95-4683b7a2873e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:38.922784 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-79127751-3896-4b65-8e95-4683b7a2873e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:38.929949 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-79127751-3896-4b65-8e95-4683b7a2873e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:38.932628 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-79127751-3896-4b65-8e95-4683b7a2873e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.503214 Oct 28 08:41:38.943073 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] validate_networks() for None {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:41:38.948524 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 156/325] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:38 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:38.964097 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2f0ffb88-6b7e-4bf0-bfeb-a915d072a1ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:38.975314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2f0ffb88-6b7e-4bf0-bfeb-a915d072a1ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:38.983578 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2f0ffb88-6b7e-4bf0-bfeb-a915d072a1ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.984278 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2f0ffb88-6b7e-4bf0-bfeb-a915d072a1ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.985269 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2f0ffb88-6b7e-4bf0-bfeb-a915d072a1ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.985882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2f0ffb88-6b7e-4bf0-bfeb-a915d072a1ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.220184 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2f0ffb88-6b7e-4bf0-bfeb-a915d072a1ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28515 microversion: 2.1 time: 0.270261 Oct 28 08:41:39.226284 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 157/326] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:38 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:39.234341 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-89ea89c8-f6f2-4dd8-a9c3-e31f5d7666b1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b6f2d91-3261-4d3a-9270-bcfe480c1c85", "device": "/dev/sdb"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:39.242152 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-89ea89c8-f6f2-4dd8-a9c3-e31f5d7666b1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:39.258291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89ea89c8-f6f2-4dd8-a9c3-e31f5d7666b1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.260099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89ea89c8-f6f2-4dd8-a9c3-e31f5d7666b1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.261069 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89ea89c8-f6f2-4dd8-a9c3-e31f5d7666b1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.262840 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89ea89c8-f6f2-4dd8-a9c3-e31f5d7666b1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.627781 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:41:39.628860 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:41:39.637226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:41:39.637226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:41:39.637226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:41:39.642666 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.643109 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.644151 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.645434 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.666160 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Getting quotas for project d17c94064e3e4771a88f32c016d0f62a. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:39.670317 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Getting quotas for user 61d26344ce664777869b68c84566d19c and project d17c94064e3e4771a88f32c016d0f62a. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:39.682826 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:41:39.685536 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:41:39.743490 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1019a64c-8635-4081-a4d4-9ffc0301991f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965724 Oct 28 08:41:39.744729 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 170/327] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:41:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:41:39.750097 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d2193a8b-c4ac-4cb2-86c1-65c8bbd48c7e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:39.760911 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d2193a8b-c4ac-4cb2-86c1-65c8bbd48c7e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:39.779036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d2193a8b-c4ac-4cb2-86c1-65c8bbd48c7e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.780619 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d2193a8b-c4ac-4cb2-86c1-65c8bbd48c7e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.781809 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d2193a8b-c4ac-4cb2-86c1-65c8bbd48c7e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.783211 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d2193a8b-c4ac-4cb2-86c1-65c8bbd48c7e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.828727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-89ea89c8-f6f2-4dd8-a9c3-e31f5d7666b1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "POST /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.600379 Oct 28 08:41:39.830794 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 158/328] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:41:39 2021] POST /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:39.871718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-078ace34-bab6-47f6-8d3a-1ca370b3b24b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:39.872451 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-078ace34-bab6-47f6-8d3a-1ca370b3b24b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:39.887864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d2193a8b-c4ac-4cb2-86c1-65c8bbd48c7e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:39.889757 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-078ace34-bab6-47f6-8d3a-1ca370b3b24b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.890287 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-078ace34-bab6-47f6-8d3a-1ca370b3b24b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.891189 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-078ace34-bab6-47f6-8d3a-1ca370b3b24b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.891624 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-078ace34-bab6-47f6-8d3a-1ca370b3b24b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.897560 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d2193a8b-c4ac-4cb2-86c1-65c8bbd48c7e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1272 microversion: 2.1 time: 0.151563 Oct 28 08:41:39.900272 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 171/329] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:39 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:39.906436 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-32d4811e-5996-461a-b2da-f23ab47f8a7a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:39.907278 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-32d4811e-5996-461a-b2da-f23ab47f8a7a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:40.000700 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-32d4811e-5996-461a-b2da-f23ab47f8a7a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:40.012693 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-32d4811e-5996-461a-b2da-f23ab47f8a7a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1214 microversion: 2.1 time: 0.109160 Oct 28 08:41:40.015759 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 172/330] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:39 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:40.031199 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4fcb5ce0-8409-43e1-932f-93f4ace34b70 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:40.033527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4fcb5ce0-8409-43e1-932f-93f4ace34b70 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:40.082174 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4fcb5ce0-8409-43e1-932f-93f4ace34b70 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.084138 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4fcb5ce0-8409-43e1-932f-93f4ace34b70 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.085246 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4fcb5ce0-8409-43e1-932f-93f4ace34b70 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.086011 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4fcb5ce0-8409-43e1-932f-93f4ace34b70 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.232669 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-078ace34-bab6-47f6-8d3a-1ca370b3b24b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:40.245930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-078ace34-bab6-47f6-8d3a-1ca370b3b24b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.390711 Oct 28 08:41:40.246781 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 159/331] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:39 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:40.255401 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-61fb796e-22fc-4822-9b30-14a3350f88ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:40.258191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-61fb796e-22fc-4822-9b30-14a3350f88ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:40.277467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61fb796e-22fc-4822-9b30-14a3350f88ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.277948 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61fb796e-22fc-4822-9b30-14a3350f88ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.278721 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61fb796e-22fc-4822-9b30-14a3350f88ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.279233 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61fb796e-22fc-4822-9b30-14a3350f88ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.333269 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4fcb5ce0-8409-43e1-932f-93f4ace34b70 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:40.341887 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4fcb5ce0-8409-43e1-932f-93f4ace34b70 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:40.343596 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4fcb5ce0-8409-43e1-932f-93f4ace34b70 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:40.344846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4fcb5ce0-8409-43e1-932f-93f4ace34b70 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.326585 Oct 28 08:41:40.345383 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 173/332] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:40 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:40.351064 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e1c85438-c638-4bfc-b0e8-44065c755c92 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Action: 'create', calling method: .version_select at 0x7f9e78a6d9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1600299402"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:40.382583 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-e1c85438-c638-4bfc-b0e8-44065c755c92 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Getting quotas for project 5c6091e93f804ac3b925a7b3e9f3c747. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:40.391126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-61fb796e-22fc-4822-9b30-14a3350f88ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28681 microversion: 2.1 time: 0.140764 Oct 28 08:41:40.391917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 160/333] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:40 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28681 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:40.393604 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-e1c85438-c638-4bfc-b0e8-44065c755c92 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Getting quotas for user 26549afb955447738168904a2c2a716b and project 5c6091e93f804ac3b925a7b3e9f3c747. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:40.620180 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-e1c85438-c638-4bfc-b0e8-44065c755c92 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Getting quotas for project 5c6091e93f804ac3b925a7b3e9f3c747. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:40.625052 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-e1c85438-c638-4bfc-b0e8-44065c755c92 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Getting quotas for user 26549afb955447738168904a2c2a716b and project 5c6091e93f804ac3b925a7b3e9f3c747. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:40.649114 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e1c85438-c638-4bfc-b0e8-44065c755c92 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.302106 Oct 28 08:41:40.651053 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 174/334] 10.222.0.74 () {60 vars in 1157 bytes} [Thu Oct 28 08:41:40 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:40.821710 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1149938649", "imageRef": "db59d4f7-9ed5-4c38-a64d-f11c21d952e9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1600299402", "networks": [{"uuid": "f9c6e8af-bb64-4005-8cfe-1ceae9c0d1cb"}]}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:40.880979 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.network.neutron [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] validate_networks() for [('f9c6e8af-bb64-4005-8cfe-1ceae9c0d1cb', None, None, None, None, None)] {{(pid=132797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:41:40.919498 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5d499b97-2089-4882-8b81-c0ef6d2a4b1e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:40.921591 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5d499b97-2089-4882-8b81-c0ef6d2a4b1e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:40.933814 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5d499b97-2089-4882-8b81-c0ef6d2a4b1e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.934294 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5d499b97-2089-4882-8b81-c0ef6d2a4b1e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.935310 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5d499b97-2089-4882-8b81-c0ef6d2a4b1e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.935757 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5d499b97-2089-4882-8b81-c0ef6d2a4b1e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.267663 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5d499b97-2089-4882-8b81-c0ef6d2a4b1e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:41.276348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5d499b97-2089-4882-8b81-c0ef6d2a4b1e tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.362894 Oct 28 08:41:41.277193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 175/335] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:40 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:41.282848 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e8ddfb77-3292-475a-a753-089347c3f190 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:41.283494 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e8ddfb77-3292-475a-a753-089347c3f190 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:41.291241 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e8ddfb77-3292-475a-a753-089347c3f190 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.292121 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e8ddfb77-3292-475a-a753-089347c3f190 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.293296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e8ddfb77-3292-475a-a753-089347c3f190 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.293988 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e8ddfb77-3292-475a-a753-089347c3f190 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.393009 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e8ddfb77-3292-475a-a753-089347c3f190 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:41.404476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e8ddfb77-3292-475a-a753-089347c3f190 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1284 microversion: 2.1 time: 0.125571 Oct 28 08:41:41.406065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 176/336] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:41 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:41.411764 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-effdc0f4-2ce2-45c7-8187-32babbc4895c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:41.412597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-effdc0f4-2ce2-45c7-8187-32babbc4895c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:41.418782 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-effdc0f4-2ce2-45c7-8187-32babbc4895c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.419510 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-effdc0f4-2ce2-45c7-8187-32babbc4895c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.420659 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-effdc0f4-2ce2-45c7-8187-32babbc4895c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.421240 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-effdc0f4-2ce2-45c7-8187-32babbc4895c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.827526 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-effdc0f4-2ce2-45c7-8187-32babbc4895c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:41.839028 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-effdc0f4-2ce2-45c7-8187-32babbc4895c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.431441 Oct 28 08:41:41.853013 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 177/337] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:41 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:41.859182 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5f764dd1-e092-4921-a82f-d8bc3b1ebb9a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:41.860284 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5f764dd1-e092-4921-a82f-d8bc3b1ebb9a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:41.869829 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5f764dd1-e092-4921-a82f-d8bc3b1ebb9a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.870670 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5f764dd1-e092-4921-a82f-d8bc3b1ebb9a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.871662 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5f764dd1-e092-4921-a82f-d8bc3b1ebb9a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.872224 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5f764dd1-e092-4921-a82f-d8bc3b1ebb9a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.889625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Flavor limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:41:41.891715 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Image limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:41:41.892204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Flavor pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:41:41.892622 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Image pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:41:41.893028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:41:41.903892 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.905412 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.906784 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.907444 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.929303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Getting quotas for project 5c6091e93f804ac3b925a7b3e9f3c747. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:41.934501 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Getting quotas for user 26549afb955447738168904a2c2a716b and project 5c6091e93f804ac3b925a7b3e9f3c747. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:41.950207 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Going to run 1 instances... {{(pid=132797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:41:41.952748 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db59d4f7-9ed5-4c38-a64d-f11c21d952e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:41:42.003723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-53e1ae4d-54cc-4bb3-a2b9-5e694195b7ff tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186125 Oct 28 08:41:42.010082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 161/338] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:41:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:41:42.010887 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-666efaf9-7aa8-4c2f-931f-5b2a1e89e037 req-8ba6910b-3373-4c5a-b8bc-d73435205244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95903824-5909-4930-9086-b397f444209f", "tag": "bfff1222-7dd2-4253-8d4c-d377f04b2acf"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:42.013708 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:42.013708 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:41:42.024603 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-666efaf9-7aa8-4c2f-931f-5b2a1e89e037 req-8ba6910b-3373-4c5a-b8bc-d73435205244 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.025059 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-666efaf9-7aa8-4c2f-931f-5b2a1e89e037 req-8ba6910b-3373-4c5a-b8bc-d73435205244 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.053262 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-666efaf9-7aa8-4c2f-931f-5b2a1e89e037 req-8ba6910b-3373-4c5a-b8bc-d73435205244 service nova] Creating event network-changed:bfff1222-7dd2-4253-8d4c-d377f04b2acf for instance 95903824-5909-4930-9086-b397f444209f on hv-cinder-81566 Oct 28 08:41:42.084575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-666efaf9-7aa8-4c2f-931f-5b2a1e89e037 req-8ba6910b-3373-4c5a-b8bc-d73435205244 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077642 Oct 28 08:41:42.085209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 162/339] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:42.104724 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5f764dd1-e092-4921-a82f-d8bc3b1ebb9a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:42.106868 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-151a35a2-6c62-4851-8b8a-ef5b55abc701 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:42.107960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-151a35a2-6c62-4851-8b8a-ef5b55abc701 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:42.117875 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5f764dd1-e092-4921-a82f-d8bc3b1ebb9a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:42.121986 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5f764dd1-e092-4921-a82f-d8bc3b1ebb9a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:42.123613 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-151a35a2-6c62-4851-8b8a-ef5b55abc701 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.124060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-151a35a2-6c62-4851-8b8a-ef5b55abc701 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.124365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5f764dd1-e092-4921-a82f-d8bc3b1ebb9a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.269439 Oct 28 08:41:42.124903 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-151a35a2-6c62-4851-8b8a-ef5b55abc701 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.127056 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-151a35a2-6c62-4851-8b8a-ef5b55abc701 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.141854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 178/340] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:41 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:42.149606 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-563dfb19-2a47-44b5-85cc-3890628ef5b3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:42.151246 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-563dfb19-2a47-44b5-85cc-3890628ef5b3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:42.246821 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-563dfb19-2a47-44b5-85cc-3890628ef5b3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:42.253240 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-563dfb19-2a47-44b5-85cc-3890628ef5b3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1259 microversion: 2.1 time: 0.110117 Oct 28 08:41:42.253849 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 179/341] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:42 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1259 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:42.294074 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6cc1e5c5-6410-46fe-a124-5961e18522b8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:42.294690 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6cc1e5c5-6410-46fe-a124-5961e18522b8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:42.303118 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6cc1e5c5-6410-46fe-a124-5961e18522b8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.314734 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6cc1e5c5-6410-46fe-a124-5961e18522b8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.315613 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6cc1e5c5-6410-46fe-a124-5961e18522b8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.318135 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6cc1e5c5-6410-46fe-a124-5961e18522b8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.521474 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-151a35a2-6c62-4851-8b8a-ef5b55abc701 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.430965 Oct 28 08:41:42.522589 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 163/342] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:42 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:42.530794 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bce0f0f8-fe83-4cef-9d1d-ec6df10d88b4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:42.533387 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bce0f0f8-fe83-4cef-9d1d-ec6df10d88b4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:42.547380 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bce0f0f8-fe83-4cef-9d1d-ec6df10d88b4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.549617 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bce0f0f8-fe83-4cef-9d1d-ec6df10d88b4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.553433 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bce0f0f8-fe83-4cef-9d1d-ec6df10d88b4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.554212 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bce0f0f8-fe83-4cef-9d1d-ec6df10d88b4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.610360 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6cc1e5c5-6410-46fe-a124-5961e18522b8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:42.622368 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6cc1e5c5-6410-46fe-a124-5961e18522b8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.332081 Oct 28 08:41:42.624929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 180/343] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:42 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:42.697313 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-bce0f0f8-fe83-4cef-9d1d-ec6df10d88b4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:42.713358 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bce0f0f8-fe83-4cef-9d1d-ec6df10d88b4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1272 microversion: 2.1 time: 0.188536 Oct 28 08:41:42.715375 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 164/344] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:42 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:42.856827 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-20ec0e77-292b-4163-aa5d-673d547035c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:42.857478 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-20ec0e77-292b-4163-aa5d-673d547035c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:42.872919 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20ec0e77-292b-4163-aa5d-673d547035c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.873364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20ec0e77-292b-4163-aa5d-673d547035c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.874317 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20ec0e77-292b-4163-aa5d-673d547035c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.874751 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20ec0e77-292b-4163-aa5d-673d547035c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.156985 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b09a1283-24fb-44c6-af96-192ffe2a1eaa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:43.157337 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b09a1283-24fb-44c6-af96-192ffe2a1eaa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:43.168986 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b09a1283-24fb-44c6-af96-192ffe2a1eaa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.169817 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b09a1283-24fb-44c6-af96-192ffe2a1eaa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.171149 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b09a1283-24fb-44c6-af96-192ffe2a1eaa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.171776 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b09a1283-24fb-44c6-af96-192ffe2a1eaa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.557527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-20ec0e77-292b-4163-aa5d-673d547035c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:43.568065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-20ec0e77-292b-4163-aa5d-673d547035c0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.715382 Oct 28 08:41:43.569563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 181/345] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:42 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:43.575429 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-abe4f69d-15a5-45b1-b93c-dbe5c76ea9de tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:43.576333 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-abe4f69d-15a5-45b1-b93c-dbe5c76ea9de tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:43.585658 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-abe4f69d-15a5-45b1-b93c-dbe5c76ea9de tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.586476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-abe4f69d-15a5-45b1-b93c-dbe5c76ea9de tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.587575 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-abe4f69d-15a5-45b1-b93c-dbe5c76ea9de tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.588212 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-abe4f69d-15a5-45b1-b93c-dbe5c76ea9de tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.679006 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b09a1283-24fb-44c6-af96-192ffe2a1eaa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:43.698479 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b09a1283-24fb-44c6-af96-192ffe2a1eaa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:43.700540 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b09a1283-24fb-44c6-af96-192ffe2a1eaa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:43.703530 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b09a1283-24fb-44c6-af96-192ffe2a1eaa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.554138 Oct 28 08:41:43.704060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 165/346] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:43 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:41:43.711224 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f9d3f409-083f-4610-abbb-1778d999d732 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:43.720506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f9d3f409-083f-4610-abbb-1778d999d732 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:43.730934 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9d3f409-083f-4610-abbb-1778d999d732 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.731382 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9d3f409-083f-4610-abbb-1778d999d732 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.732221 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9d3f409-083f-4610-abbb-1778d999d732 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.732829 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9d3f409-083f-4610-abbb-1778d999d732 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.748685 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-abe4f69d-15a5-45b1-b93c-dbe5c76ea9de tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:43.756994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-abe4f69d-15a5-45b1-b93c-dbe5c76ea9de tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1329 microversion: 2.1 time: 0.185668 Oct 28 08:41:43.767766 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 182/347] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:43 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1329 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:43.774238 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-807389bb-3056-474a-a32c-c26e369d2cc6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:43.774846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-807389bb-3056-474a-a32c-c26e369d2cc6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:43.780649 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-807389bb-3056-474a-a32c-c26e369d2cc6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.781088 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-807389bb-3056-474a-a32c-c26e369d2cc6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.781885 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-807389bb-3056-474a-a32c-c26e369d2cc6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.782307 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-807389bb-3056-474a-a32c-c26e369d2cc6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.875483 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f9d3f409-083f-4610-abbb-1778d999d732 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.169962 Oct 28 08:41:43.881764 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 166/348] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:43 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:43.896144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c45d620e-4d9a-4292-9911-867c74c8e80f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:43.896951 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c45d620e-4d9a-4292-9911-867c74c8e80f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:43.922503 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c45d620e-4d9a-4292-9911-867c74c8e80f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.922955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c45d620e-4d9a-4292-9911-867c74c8e80f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.923748 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c45d620e-4d9a-4292-9911-867c74c8e80f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.934225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c45d620e-4d9a-4292-9911-867c74c8e80f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:44.209630 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-807389bb-3056-474a-a32c-c26e369d2cc6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:44.218274 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-807389bb-3056-474a-a32c-c26e369d2cc6 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.448713 Oct 28 08:41:44.228912 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 183/349] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:43 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:44.323045 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c45d620e-4d9a-4292-9911-867c74c8e80f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:44.333554 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c45d620e-4d9a-4292-9911-867c74c8e80f tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.450086 Oct 28 08:41:44.334369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 167/350] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:43 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:44.420200 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-f524e87b-29ef-41c3-bfea-a25678e4b825 req-0dd987c4-f79f-4c1e-8e89-6a3f3ac6d588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb953696-803c-4e65-817a-a00f31b18289", "tag": "552b122b-0a21-4e0d-8069-7363bb657c19"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:44.423997 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:44.423997 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:41:44.442962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-f524e87b-29ef-41c3-bfea-a25678e4b825 req-0dd987c4-f79f-4c1e-8e89-6a3f3ac6d588 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:44.443446 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-f524e87b-29ef-41c3-bfea-a25678e4b825 req-0dd987c4-f79f-4c1e-8e89-6a3f3ac6d588 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:44.476783 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-f524e87b-29ef-41c3-bfea-a25678e4b825 req-0dd987c4-f79f-4c1e-8e89-6a3f3ac6d588 service nova] Creating event network-changed:552b122b-0a21-4e0d-8069-7363bb657c19 for instance fb953696-803c-4e65-817a-a00f31b18289 on hv-cinder-81566 Oct 28 08:41:44.492728 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-f524e87b-29ef-41c3-bfea-a25678e4b825 req-0dd987c4-f79f-4c1e-8e89-6a3f3ac6d588 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073452 Oct 28 08:41:44.493763 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 184/351] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:44.585723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c88d0f64-c419-4094-adfb-df42060d3dab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:44.586358 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c88d0f64-c419-4094-adfb-df42060d3dab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:44.597376 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c88d0f64-c419-4094-adfb-df42060d3dab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:44.598660 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c88d0f64-c419-4094-adfb-df42060d3dab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:44.599600 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c88d0f64-c419-4094-adfb-df42060d3dab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:44.604011 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c88d0f64-c419-4094-adfb-df42060d3dab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:44.727007 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-199aadb9-6332-4b26-ab34-8893a4cf2d3d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:44.727953 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-199aadb9-6332-4b26-ab34-8893a4cf2d3d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:44.735605 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-199aadb9-6332-4b26-ab34-8893a4cf2d3d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:44.737412 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-199aadb9-6332-4b26-ab34-8893a4cf2d3d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:44.738478 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-199aadb9-6332-4b26-ab34-8893a4cf2d3d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:44.740250 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-199aadb9-6332-4b26-ab34-8893a4cf2d3d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:44.943247 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c88d0f64-c419-4094-adfb-df42060d3dab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:44.954963 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c88d0f64-c419-4094-adfb-df42060d3dab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1500 microversion: 2.1 time: 0.372587 Oct 28 08:41:44.956726 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 168/352] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:44 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1500 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:44.977675 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dee9e1d2-76f1-4dee-a350-2200ad6f0417 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:44.994704 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dee9e1d2-76f1-4dee-a350-2200ad6f0417 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:45.006616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dee9e1d2-76f1-4dee-a350-2200ad6f0417 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.012762 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dee9e1d2-76f1-4dee-a350-2200ad6f0417 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:45.014169 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dee9e1d2-76f1-4dee-a350-2200ad6f0417 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.016383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dee9e1d2-76f1-4dee-a350-2200ad6f0417 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:45.236929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-199aadb9-6332-4b26-ab34-8893a4cf2d3d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:45.252591 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-199aadb9-6332-4b26-ab34-8893a4cf2d3d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:45.257802 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-199aadb9-6332-4b26-ab34-8893a4cf2d3d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:45.262300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-199aadb9-6332-4b26-ab34-8893a4cf2d3d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.541033 Oct 28 08:41:45.281426 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 185/353] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:44 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:45.294569 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ec5271a8-2728-4778-b23d-9ab761203186 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:45.298041 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ec5271a8-2728-4778-b23d-9ab761203186 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:45.314432 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ec5271a8-2728-4778-b23d-9ab761203186 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.315153 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ec5271a8-2728-4778-b23d-9ab761203186 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:45.320092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ec5271a8-2728-4778-b23d-9ab761203186 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.321907 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ec5271a8-2728-4778-b23d-9ab761203186 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:45.456886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dee9e1d2-76f1-4dee-a350-2200ad6f0417 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:45.466836 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dee9e1d2-76f1-4dee-a350-2200ad6f0417 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.506091 Oct 28 08:41:45.470323 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 169/354] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:44 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:45.482331 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-31e84f6c-5669-4bfd-b14d-5c5e365d09ba tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc03f832-e91a-453f-a3bb-a4d4926b8456"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:45.487385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-31e84f6c-5669-4bfd-b14d-5c5e365d09ba tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:45.502693 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31e84f6c-5669-4bfd-b14d-5c5e365d09ba tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.507552 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31e84f6c-5669-4bfd-b14d-5c5e365d09ba tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:45.510644 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31e84f6c-5669-4bfd-b14d-5c5e365d09ba tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.512497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31e84f6c-5669-4bfd-b14d-5c5e365d09ba tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:45.570233 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-31e84f6c-5669-4bfd-b14d-5c5e365d09ba tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] HTTP exception thrown: Cannot 'attach_volume' instance c70c146b-a5ed-43af-aad8-18fb35f2dab5 while it is in vm_state rescued Oct 28 08:41:45.571287 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-31e84f6c-5669-4bfd-b14d-5c5e365d09ba tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Returning 409 to user: Cannot 'attach_volume' instance c70c146b-a5ed-43af-aad8-18fb35f2dab5 while it is in vm_state rescued {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:45.572346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-31e84f6c-5669-4bfd-b14d-5c5e365d09ba tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.100076 Oct 28 08:41:45.573874 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 170/355] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:41:45 2021] POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 08:41:45.581111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-604bb5dc-a870-4c27-8a24-f6f70d0b9892 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:45.583275 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-604bb5dc-a870-4c27-8a24-f6f70d0b9892 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:45.592878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-604bb5dc-a870-4c27-8a24-f6f70d0b9892 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.593595 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-604bb5dc-a870-4c27-8a24-f6f70d0b9892 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:45.594447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-604bb5dc-a870-4c27-8a24-f6f70d0b9892 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.594879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-604bb5dc-a870-4c27-8a24-f6f70d0b9892 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:45.847527 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-604bb5dc-a870-4c27-8a24-f6f70d0b9892 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:45.859750 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-604bb5dc-a870-4c27-8a24-f6f70d0b9892 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.284301 Oct 28 08:41:45.860650 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 171/356] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:45 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:45.865402 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-82f99651-7cd5-4f42-b397-f7e20ce60c2a req-c086fe09-bf0e-448b-a868-7d82c4c7f501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423157c3-a1e9-43c5-8fda-01d1d93bd484", "name": "network-vif-plugged", "status": "completed", "tag": "2e8c6f82-a258-4342-aacf-0b4e80ccd12e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:45.867389 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:45.867389 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:41:45.874645 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-82f99651-7cd5-4f42-b397-f7e20ce60c2a req-c086fe09-bf0e-448b-a868-7d82c4c7f501 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.875086 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-82f99651-7cd5-4f42-b397-f7e20ce60c2a req-c086fe09-bf0e-448b-a868-7d82c4c7f501 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:45.887247 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-82f99651-7cd5-4f42-b397-f7e20ce60c2a req-c086fe09-bf0e-448b-a868-7d82c4c7f501 service nova] Creating event network-vif-plugged:2e8c6f82-a258-4342-aacf-0b4e80ccd12e for instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 on hv-cinder-81566 Oct 28 08:41:45.893152 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-82f99651-7cd5-4f42-b397-f7e20ce60c2a req-c086fe09-bf0e-448b-a868-7d82c4c7f501 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031124 Oct 28 08:41:45.893751 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 172/357] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:45.920255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-77683a4f-2db2-4226-898c-bbd8a6052f19 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:45.925459 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-77683a4f-2db2-4226-898c-bbd8a6052f19 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:45.935522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-77683a4f-2db2-4226-898c-bbd8a6052f19 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.936195 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-77683a4f-2db2-4226-898c-bbd8a6052f19 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:45.937834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-77683a4f-2db2-4226-898c-bbd8a6052f19 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:45.938730 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-77683a4f-2db2-4226-898c-bbd8a6052f19 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.198827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-77683a4f-2db2-4226-898c-bbd8a6052f19 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:46.210569 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-77683a4f-2db2-4226-898c-bbd8a6052f19 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.315317 Oct 28 08:41:46.213329 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 173/358] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:45 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:46.220905 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fee008b2-2593-4620-8318-40f14154c149 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:46.221767 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fee008b2-2593-4620-8318-40f14154c149 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:46.229250 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fee008b2-2593-4620-8318-40f14154c149 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.230160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fee008b2-2593-4620-8318-40f14154c149 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.231610 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fee008b2-2593-4620-8318-40f14154c149 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.232573 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fee008b2-2593-4620-8318-40f14154c149 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.369979 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fee008b2-2593-4620-8318-40f14154c149 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/action" status: 202 len: 0 microversion: 2.1 time: 0.150906 Oct 28 08:41:46.375749 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 174/359] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:46 2021] POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:46.387414 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-51c97a7a-4970-4ba9-9bb3-3a3ef810c726 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:46.388650 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-51c97a7a-4970-4ba9-9bb3-3a3ef810c726 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:46.396127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-51c97a7a-4970-4ba9-9bb3-3a3ef810c726 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.406150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-51c97a7a-4970-4ba9-9bb3-3a3ef810c726 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.407121 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-51c97a7a-4970-4ba9-9bb3-3a3ef810c726 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.407785 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-51c97a7a-4970-4ba9-9bb3-3a3ef810c726 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.626930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-51c97a7a-4970-4ba9-9bb3-3a3ef810c726 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:46.635757 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-51c97a7a-4970-4ba9-9bb3-3a3ef810c726 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:46.637251 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-51c97a7a-4970-4ba9-9bb3-3a3ef810c726 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:46.638389 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-51c97a7a-4970-4ba9-9bb3-3a3ef810c726 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.255523 Oct 28 08:41:46.638946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 175/360] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:46 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:46.646461 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-cb36a955-3920-4040-a42b-6142ef80ef49 req-f0778d0b-e6ca-410d-9811-f74970c6b059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50b0126-b6b3-4fbf-8596-0f7b3d5877f6", "tag": "760c9603-2fe5-4dc3-aa4c-7ff255fee93d"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:46.648149 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:46.648149 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:41:46.663493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-cb36a955-3920-4040-a42b-6142ef80ef49 req-f0778d0b-e6ca-410d-9811-f74970c6b059 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.663794 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-cb36a955-3920-4040-a42b-6142ef80ef49 req-f0778d0b-e6ca-410d-9811-f74970c6b059 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.691447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-cb36a955-3920-4040-a42b-6142ef80ef49 req-f0778d0b-e6ca-410d-9811-f74970c6b059 service nova] Creating event network-changed:760c9603-2fe5-4dc3-aa4c-7ff255fee93d for instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 on hv-cinder-81566 Oct 28 08:41:46.699550 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-cb36a955-3920-4040-a42b-6142ef80ef49 req-f0778d0b-e6ca-410d-9811-f74970c6b059 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058901 Oct 28 08:41:46.710834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 176/361] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:46.717684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7375aa48-96ef-4445-b01c-e618ffd8f49e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:46.718783 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7375aa48-96ef-4445-b01c-e618ffd8f49e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:46.734656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7375aa48-96ef-4445-b01c-e618ffd8f49e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.735151 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7375aa48-96ef-4445-b01c-e618ffd8f49e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.735928 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7375aa48-96ef-4445-b01c-e618ffd8f49e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.736362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7375aa48-96ef-4445-b01c-e618ffd8f49e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.941467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-7375aa48-96ef-4445-b01c-e618ffd8f49e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:46.950613 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7375aa48-96ef-4445-b01c-e618ffd8f49e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.238189 Oct 28 08:41:46.951126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 177/362] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:46 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:46.963450 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9eeedef0-8132-4f57-b8f9-d7f82cade9fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:46.964063 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9eeedef0-8132-4f57-b8f9-d7f82cade9fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:46.970249 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9eeedef0-8132-4f57-b8f9-d7f82cade9fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.970690 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9eeedef0-8132-4f57-b8f9-d7f82cade9fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.971745 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9eeedef0-8132-4f57-b8f9-d7f82cade9fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.972779 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9eeedef0-8132-4f57-b8f9-d7f82cade9fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.125968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9eeedef0-8132-4f57-b8f9-d7f82cade9fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:47.137691 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9eeedef0-8132-4f57-b8f9-d7f82cade9fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.185529 Oct 28 08:41:47.138837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 178/363] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:46 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:47.144443 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6bec28c9-6db8-4498-b16d-1768efe46247 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:47.145698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6bec28c9-6db8-4498-b16d-1768efe46247 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:47.152097 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6bec28c9-6db8-4498-b16d-1768efe46247 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.152541 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6bec28c9-6db8-4498-b16d-1768efe46247 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.153303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6bec28c9-6db8-4498-b16d-1768efe46247 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.153722 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6bec28c9-6db8-4498-b16d-1768efe46247 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.307415 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6bec28c9-6db8-4498-b16d-1768efe46247 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:47.316406 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6bec28c9-6db8-4498-b16d-1768efe46247 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.176071 Oct 28 08:41:47.318276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 179/364] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:47 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:47.327335 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6998a3a3-1d54-4c61-a07c-3fc23dd94804 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:47.327335 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6998a3a3-1d54-4c61-a07c-3fc23dd94804 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:47.332073 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6998a3a3-1d54-4c61-a07c-3fc23dd94804 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.333087 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6998a3a3-1d54-4c61-a07c-3fc23dd94804 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.334326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6998a3a3-1d54-4c61-a07c-3fc23dd94804 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.334961 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6998a3a3-1d54-4c61-a07c-3fc23dd94804 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.489588 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6998a3a3-1d54-4c61-a07c-3fc23dd94804 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:47.497264 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6998a3a3-1d54-4c61-a07c-3fc23dd94804 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.177804 Oct 28 08:41:47.497849 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 180/365] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:47 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:47.657247 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d41abc2b-9dc0-419c-bcde-e622c26f9e12 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:47.674033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d41abc2b-9dc0-419c-bcde-e622c26f9e12 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:47.689736 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d41abc2b-9dc0-419c-bcde-e622c26f9e12 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.690300 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d41abc2b-9dc0-419c-bcde-e622c26f9e12 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.691262 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d41abc2b-9dc0-419c-bcde-e622c26f9e12 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.691689 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d41abc2b-9dc0-419c-bcde-e622c26f9e12 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.873145 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d41abc2b-9dc0-419c-bcde-e622c26f9e12 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:47.882085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d41abc2b-9dc0-419c-bcde-e622c26f9e12 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:47.883595 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d41abc2b-9dc0-419c-bcde-e622c26f9e12 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:47.884827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d41abc2b-9dc0-419c-bcde-e622c26f9e12 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.231540 Oct 28 08:41:47.896146 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 181/366] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:47 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:41:47.970060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-66ac4d44-f617-4b4d-be3b-c15a7b736396 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:47.971016 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-66ac4d44-f617-4b4d-be3b-c15a7b736396 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:47.984077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66ac4d44-f617-4b4d-be3b-c15a7b736396 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.984701 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66ac4d44-f617-4b4d-be3b-c15a7b736396 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.985493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66ac4d44-f617-4b4d-be3b-c15a7b736396 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.986015 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66ac4d44-f617-4b4d-be3b-c15a7b736396 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.124111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-66ac4d44-f617-4b4d-be3b-c15a7b736396 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:48.157595 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-66ac4d44-f617-4b4d-be3b-c15a7b736396 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.192364 Oct 28 08:41:48.158581 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 182/367] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:47 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:48.164143 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-02c30d53-c58e-4115-917c-b078904c3eda tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:48.164950 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-02c30d53-c58e-4115-917c-b078904c3eda tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:48.170995 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-02c30d53-c58e-4115-917c-b078904c3eda tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.171436 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-02c30d53-c58e-4115-917c-b078904c3eda tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.172206 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-02c30d53-c58e-4115-917c-b078904c3eda tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.172633 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-02c30d53-c58e-4115-917c-b078904c3eda tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.335501 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-02c30d53-c58e-4115-917c-b078904c3eda tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:48.343380 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-02c30d53-c58e-4115-917c-b078904c3eda tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.183660 Oct 28 08:41:48.344007 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 183/368] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:48 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:48.348691 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-567e8530-cd01-4f93-885e-3202f5e10bc2 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:48.349695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-567e8530-cd01-4f93-885e-3202f5e10bc2 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:48.355696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-567e8530-cd01-4f93-885e-3202f5e10bc2 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.356144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-567e8530-cd01-4f93-885e-3202f5e10bc2 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.356916 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-567e8530-cd01-4f93-885e-3202f5e10bc2 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.357349 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-567e8530-cd01-4f93-885e-3202f5e10bc2 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.599837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-567e8530-cd01-4f93-885e-3202f5e10bc2 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:48.611231 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-567e8530-cd01-4f93-885e-3202f5e10bc2 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.266169 Oct 28 08:41:48.612139 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 184/369] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:48 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:48.627462 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3311088d-7a05-4055-82a8-54a7b5db0db9 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:48.628333 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3311088d-7a05-4055-82a8-54a7b5db0db9 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:48.635165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3311088d-7a05-4055-82a8-54a7b5db0db9 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.635689 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3311088d-7a05-4055-82a8-54a7b5db0db9 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.636672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3311088d-7a05-4055-82a8-54a7b5db0db9 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.637295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3311088d-7a05-4055-82a8-54a7b5db0db9 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.804361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3311088d-7a05-4055-82a8-54a7b5db0db9 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:48.814076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3311088d-7a05-4055-82a8-54a7b5db0db9 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.190685 Oct 28 08:41:48.814679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 185/370] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:48 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:48.902921 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f725a6a7-f31b-4125-82fc-1b4563a04ed0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:48.903852 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f725a6a7-f31b-4125-82fc-1b4563a04ed0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:48.910295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f725a6a7-f31b-4125-82fc-1b4563a04ed0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.911215 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f725a6a7-f31b-4125-82fc-1b4563a04ed0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.912236 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f725a6a7-f31b-4125-82fc-1b4563a04ed0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.912743 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f725a6a7-f31b-4125-82fc-1b4563a04ed0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:49.058084 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f725a6a7-f31b-4125-82fc-1b4563a04ed0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:49.066175 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f725a6a7-f31b-4125-82fc-1b4563a04ed0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:49.068706 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f725a6a7-f31b-4125-82fc-1b4563a04ed0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:49.069885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f725a6a7-f31b-4125-82fc-1b4563a04ed0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.170653 Oct 28 08:41:49.082591 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 186/371] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:48 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:41:49.182514 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7d838e1c-1149-4ac0-b0d4-6b3e8cb3973a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:49.183539 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7d838e1c-1149-4ac0-b0d4-6b3e8cb3973a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:49.192646 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7d838e1c-1149-4ac0-b0d4-6b3e8cb3973a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:49.193257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7d838e1c-1149-4ac0-b0d4-6b3e8cb3973a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:49.194083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7d838e1c-1149-4ac0-b0d4-6b3e8cb3973a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:49.194519 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7d838e1c-1149-4ac0-b0d4-6b3e8cb3973a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:49.345774 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-7d838e1c-1149-4ac0-b0d4-6b3e8cb3973a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:49.354799 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7d838e1c-1149-4ac0-b0d4-6b3e8cb3973a tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.181566 Oct 28 08:41:49.355725 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 187/372] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:49 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:49.360122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-db7aed93-f383-4bb3-ae54-9a3dafe49d20 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:49.360808 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-db7aed93-f383-4bb3-ae54-9a3dafe49d20 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:49.369032 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-db7aed93-f383-4bb3-ae54-9a3dafe49d20 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:49.370280 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-db7aed93-f383-4bb3-ae54-9a3dafe49d20 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:49.372218 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-db7aed93-f383-4bb3-ae54-9a3dafe49d20 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:49.372659 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-db7aed93-f383-4bb3-ae54-9a3dafe49d20 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:49.540194 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-db7aed93-f383-4bb3-ae54-9a3dafe49d20 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:49.547706 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-db7aed93-f383-4bb3-ae54-9a3dafe49d20 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.190950 Oct 28 08:41:49.548282 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 188/373] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:49 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:49.628285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-513b624d-2dd6-4213-85b9-6b05813fe270 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:49.629141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-513b624d-2dd6-4213-85b9-6b05813fe270 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:49.635690 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-513b624d-2dd6-4213-85b9-6b05813fe270 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:49.636131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-513b624d-2dd6-4213-85b9-6b05813fe270 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:49.636934 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-513b624d-2dd6-4213-85b9-6b05813fe270 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:49.637361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-513b624d-2dd6-4213-85b9-6b05813fe270 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:49.897707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-513b624d-2dd6-4213-85b9-6b05813fe270 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:49.914434 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-513b624d-2dd6-4213-85b9-6b05813fe270 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.289716 Oct 28 08:41:49.915868 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 189/374] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:49 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:49.920303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dc793245-7137-40a3-9432-85d64bd58af2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:49.920900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dc793245-7137-40a3-9432-85d64bd58af2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:49.927516 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dc793245-7137-40a3-9432-85d64bd58af2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:49.927945 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dc793245-7137-40a3-9432-85d64bd58af2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:49.928798 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dc793245-7137-40a3-9432-85d64bd58af2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:49.929230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dc793245-7137-40a3-9432-85d64bd58af2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:50.078412 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dc793245-7137-40a3-9432-85d64bd58af2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:50.089017 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dc793245-7137-40a3-9432-85d64bd58af2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.171582 Oct 28 08:41:50.090068 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 190/375] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:49 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:50.101131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8a1581d6-d868-40c1-86a5-a8539340904a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:50.101879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8a1581d6-d868-40c1-86a5-a8539340904a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:50.108914 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8a1581d6-d868-40c1-86a5-a8539340904a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:50.109497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8a1581d6-d868-40c1-86a5-a8539340904a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:50.110412 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8a1581d6-d868-40c1-86a5-a8539340904a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:50.111049 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8a1581d6-d868-40c1-86a5-a8539340904a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:50.290150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8a1581d6-d868-40c1-86a5-a8539340904a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:50.298457 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8a1581d6-d868-40c1-86a5-a8539340904a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:50.299933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8a1581d6-d868-40c1-86a5-a8539340904a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:50.301030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8a1581d6-d868-40c1-86a5-a8539340904a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.204962 Oct 28 08:41:50.303124 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 191/376] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:50 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:41:50.411148 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6c5b6f30-e892-4364-9595-17119fd52adc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:50.412154 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6c5b6f30-e892-4364-9595-17119fd52adc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:50.418419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c5b6f30-e892-4364-9595-17119fd52adc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:50.419345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c5b6f30-e892-4364-9595-17119fd52adc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:50.419857 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c5b6f30-e892-4364-9595-17119fd52adc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:50.420292 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c5b6f30-e892-4364-9595-17119fd52adc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:50.574032 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6c5b6f30-e892-4364-9595-17119fd52adc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:50.581979 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6c5b6f30-e892-4364-9595-17119fd52adc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.212679 Oct 28 08:41:50.583627 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 192/377] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:50 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:50.591481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c7254d04-481a-4436-b4cc-1cfbaaa76f55 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:50.592466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c7254d04-481a-4436-b4cc-1cfbaaa76f55 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:50.601196 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7254d04-481a-4436-b4cc-1cfbaaa76f55 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:50.601824 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7254d04-481a-4436-b4cc-1cfbaaa76f55 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:50.602763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7254d04-481a-4436-b4cc-1cfbaaa76f55 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:50.603389 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c7254d04-481a-4436-b4cc-1cfbaaa76f55 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:50.779073 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c7254d04-481a-4436-b4cc-1cfbaaa76f55 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:50.790860 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c7254d04-481a-4436-b4cc-1cfbaaa76f55 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.203943 Oct 28 08:41:50.791586 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 193/378] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:50 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:50.942852 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-785aecc8-5d1a-4cb1-bb6e-a732648ec753 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:50.944345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-785aecc8-5d1a-4cb1-bb6e-a732648ec753 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:50.958923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-785aecc8-5d1a-4cb1-bb6e-a732648ec753 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:50.959983 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-785aecc8-5d1a-4cb1-bb6e-a732648ec753 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:50.961714 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-785aecc8-5d1a-4cb1-bb6e-a732648ec753 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:50.962551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-785aecc8-5d1a-4cb1-bb6e-a732648ec753 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:51.159239 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-785aecc8-5d1a-4cb1-bb6e-a732648ec753 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:51.178747 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-785aecc8-5d1a-4cb1-bb6e-a732648ec753 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.249006 Oct 28 08:41:51.179652 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 194/379] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:50 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:51.184332 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-6738577d-2a16-403c-8939-44b04ef43c89 req-57069cfe-eb28-4ad9-9b1b-b1d4859a38f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95903824-5909-4930-9086-b397f444209f", "name": "network-vif-plugged", "status": "completed", "tag": "bfff1222-7dd2-4253-8d4c-d377f04b2acf"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:51.186103 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:51.186103 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:41:51.195973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-6738577d-2a16-403c-8939-44b04ef43c89 req-57069cfe-eb28-4ad9-9b1b-b1d4859a38f3 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:51.196446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-6738577d-2a16-403c-8939-44b04ef43c89 req-57069cfe-eb28-4ad9-9b1b-b1d4859a38f3 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:51.209192 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-6738577d-2a16-403c-8939-44b04ef43c89 req-57069cfe-eb28-4ad9-9b1b-b1d4859a38f3 service nova] Creating event network-vif-plugged:bfff1222-7dd2-4253-8d4c-d377f04b2acf for instance 95903824-5909-4930-9086-b397f444209f on hv-cinder-81566 Oct 28 08:41:51.217707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-6738577d-2a16-403c-8939-44b04ef43c89 req-57069cfe-eb28-4ad9-9b1b-b1d4859a38f3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036553 Oct 28 08:41:51.218393 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 195/380] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:51.227407 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6195c0d7-38f0-4b17-9846-b8308f30098b tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:51.228106 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6195c0d7-38f0-4b17-9846-b8308f30098b tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:51.234212 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6195c0d7-38f0-4b17-9846-b8308f30098b tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:51.234645 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6195c0d7-38f0-4b17-9846-b8308f30098b tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:51.235441 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6195c0d7-38f0-4b17-9846-b8308f30098b tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:51.235845 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6195c0d7-38f0-4b17-9846-b8308f30098b tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:51.392752 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6195c0d7-38f0-4b17-9846-b8308f30098b tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:51.400971 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6195c0d7-38f0-4b17-9846-b8308f30098b tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.178640 Oct 28 08:41:51.401574 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 196/381] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:51 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:51.414309 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-99c8af6e-7060-4c45-991a-e0dd939c301f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:51.414920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-99c8af6e-7060-4c45-991a-e0dd939c301f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:51.421178 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99c8af6e-7060-4c45-991a-e0dd939c301f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:51.421914 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99c8af6e-7060-4c45-991a-e0dd939c301f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:51.422918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99c8af6e-7060-4c45-991a-e0dd939c301f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:51.423367 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99c8af6e-7060-4c45-991a-e0dd939c301f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:51.594146 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-99c8af6e-7060-4c45-991a-e0dd939c301f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:51.602105 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-99c8af6e-7060-4c45-991a-e0dd939c301f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:51.603601 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-99c8af6e-7060-4c45-991a-e0dd939c301f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:51.604696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-99c8af6e-7060-4c45-991a-e0dd939c301f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.202114 Oct 28 08:41:51.605256 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 197/382] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:51 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:51.642680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fe903de1-bd23-4888-94f8-aa3006dff4a2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:51.643293 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fe903de1-bd23-4888-94f8-aa3006dff4a2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:51.650400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fe903de1-bd23-4888-94f8-aa3006dff4a2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:51.651101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fe903de1-bd23-4888-94f8-aa3006dff4a2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:51.652125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fe903de1-bd23-4888-94f8-aa3006dff4a2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:51.652723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fe903de1-bd23-4888-94f8-aa3006dff4a2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:51.822181 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fe903de1-bd23-4888-94f8-aa3006dff4a2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:51.830115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fe903de1-bd23-4888-94f8-aa3006dff4a2 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.191207 Oct 28 08:41:51.830720 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 198/383] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:51 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:51.836723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0831efb2-6f47-4473-b172-da5906940920 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:51.838171 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0831efb2-6f47-4473-b172-da5906940920 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:51.857417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0831efb2-6f47-4473-b172-da5906940920 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:51.857417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0831efb2-6f47-4473-b172-da5906940920 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:51.857417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0831efb2-6f47-4473-b172-da5906940920 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:51.857417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0831efb2-6f47-4473-b172-da5906940920 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:52.018114 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0831efb2-6f47-4473-b172-da5906940920 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:52.026081 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0831efb2-6f47-4473-b172-da5906940920 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.194159 Oct 28 08:41:52.026654 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 199/384] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:51 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:52.197616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c967b437-908b-4d12-a50a-075376af7bc1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:52.198261 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c967b437-908b-4d12-a50a-075376af7bc1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:52.214585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c967b437-908b-4d12-a50a-075376af7bc1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:52.214942 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c967b437-908b-4d12-a50a-075376af7bc1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:52.215736 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c967b437-908b-4d12-a50a-075376af7bc1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:52.216173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c967b437-908b-4d12-a50a-075376af7bc1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:52.383958 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c967b437-908b-4d12-a50a-075376af7bc1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:52.392197 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c967b437-908b-4d12-a50a-075376af7bc1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.200030 Oct 28 08:41:52.402586 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 200/385] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:52 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:52.423115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d239d457-d848-4850-9435-15dd16946662 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:52.424151 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d239d457-d848-4850-9435-15dd16946662 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:52.431899 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d239d457-d848-4850-9435-15dd16946662 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:52.432470 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d239d457-d848-4850-9435-15dd16946662 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:52.434093 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d239d457-d848-4850-9435-15dd16946662 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:52.435065 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d239d457-d848-4850-9435-15dd16946662 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:52.600830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d239d457-d848-4850-9435-15dd16946662 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:52.608620 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d239d457-d848-4850-9435-15dd16946662 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.194293 Oct 28 08:41:52.609390 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 201/386] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:52 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:52.622943 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-888ec249-6ca4-45c3-9e95-fb9ebcc02683 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:52.623570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-888ec249-6ca4-45c3-9e95-fb9ebcc02683 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:52.632291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-888ec249-6ca4-45c3-9e95-fb9ebcc02683 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:52.633181 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-888ec249-6ca4-45c3-9e95-fb9ebcc02683 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:52.634562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-888ec249-6ca4-45c3-9e95-fb9ebcc02683 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:52.635256 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-888ec249-6ca4-45c3-9e95-fb9ebcc02683 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:52.784340 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-888ec249-6ca4-45c3-9e95-fb9ebcc02683 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:52.802703 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-888ec249-6ca4-45c3-9e95-fb9ebcc02683 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:52.804653 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-888ec249-6ca4-45c3-9e95-fb9ebcc02683 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:52.805985 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-888ec249-6ca4-45c3-9e95-fb9ebcc02683 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.186688 Oct 28 08:41:52.816661 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 202/387] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:52 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:41:52.856114 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d7679042-b1fc-4e3f-9594-09f0863bd6b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:52.857029 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d7679042-b1fc-4e3f-9594-09f0863bd6b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:52.866344 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7679042-b1fc-4e3f-9594-09f0863bd6b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:52.866775 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7679042-b1fc-4e3f-9594-09f0863bd6b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:52.867551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7679042-b1fc-4e3f-9594-09f0863bd6b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:52.867953 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7679042-b1fc-4e3f-9594-09f0863bd6b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.031602 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d7679042-b1fc-4e3f-9594-09f0863bd6b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:53.039785 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d7679042-b1fc-4e3f-9594-09f0863bd6b6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.189444 Oct 28 08:41:53.040354 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 203/388] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:52 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:53.045098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-deb328ec-6715-40e5-85da-1321f12bd994 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:53.045699 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-deb328ec-6715-40e5-85da-1321f12bd994 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:53.052220 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-deb328ec-6715-40e5-85da-1321f12bd994 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.052660 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-deb328ec-6715-40e5-85da-1321f12bd994 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.053437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-deb328ec-6715-40e5-85da-1321f12bd994 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.053887 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-deb328ec-6715-40e5-85da-1321f12bd994 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.188713 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-deb328ec-6715-40e5-85da-1321f12bd994 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:53.196213 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-deb328ec-6715-40e5-85da-1321f12bd994 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.154915 Oct 28 08:41:53.196781 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 204/389] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:53 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:53.415703 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9667a81d-4f3d-4b18-8d48-f3ba3f4e36b1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:53.416303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9667a81d-4f3d-4b18-8d48-f3ba3f4e36b1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:53.422861 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9667a81d-4f3d-4b18-8d48-f3ba3f4e36b1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.423303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9667a81d-4f3d-4b18-8d48-f3ba3f4e36b1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.424079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9667a81d-4f3d-4b18-8d48-f3ba3f4e36b1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.424513 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9667a81d-4f3d-4b18-8d48-f3ba3f4e36b1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.575060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9667a81d-4f3d-4b18-8d48-f3ba3f4e36b1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:53.582731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9667a81d-4f3d-4b18-8d48-f3ba3f4e36b1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.176478 Oct 28 08:41:53.583445 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 205/390] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:53 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:53.626235 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6cabf394-f264-4fb0-ae1c-64ba7b66c156 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:53.626954 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6cabf394-f264-4fb0-ae1c-64ba7b66c156 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:53.635542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6cabf394-f264-4fb0-ae1c-64ba7b66c156 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.635975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6cabf394-f264-4fb0-ae1c-64ba7b66c156 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.636762 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6cabf394-f264-4fb0-ae1c-64ba7b66c156 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.637178 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6cabf394-f264-4fb0-ae1c-64ba7b66c156 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.766649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6cabf394-f264-4fb0-ae1c-64ba7b66c156 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:53.780019 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6cabf394-f264-4fb0-ae1c-64ba7b66c156 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.158524 Oct 28 08:41:53.780512 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 206/391] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:53 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:53.823904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b8ad86b8-c967-40d7-941d-a5a277fe0835 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:53.824509 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b8ad86b8-c967-40d7-941d-a5a277fe0835 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:53.831134 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8ad86b8-c967-40d7-941d-a5a277fe0835 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.831579 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8ad86b8-c967-40d7-941d-a5a277fe0835 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.832385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8ad86b8-c967-40d7-941d-a5a277fe0835 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.832795 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8ad86b8-c967-40d7-941d-a5a277fe0835 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.002217 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b8ad86b8-c967-40d7-941d-a5a277fe0835 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:54.010617 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b8ad86b8-c967-40d7-941d-a5a277fe0835 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:54.012108 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b8ad86b8-c967-40d7-941d-a5a277fe0835 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:54.013200 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b8ad86b8-c967-40d7-941d-a5a277fe0835 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.193075 Oct 28 08:41:54.013777 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 207/392] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:53 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:41:54.062131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ef9765d4-3344-46c2-a642-f9b72c077ae4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:54.062827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ef9765d4-3344-46c2-a642-f9b72c077ae4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:54.070293 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ef9765d4-3344-46c2-a642-f9b72c077ae4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.070739 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ef9765d4-3344-46c2-a642-f9b72c077ae4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.071512 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ef9765d4-3344-46c2-a642-f9b72c077ae4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.071937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ef9765d4-3344-46c2-a642-f9b72c077ae4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.219522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ef9765d4-3344-46c2-a642-f9b72c077ae4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:54.227221 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ef9765d4-3344-46c2-a642-f9b72c077ae4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.172693 Oct 28 08:41:54.227902 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 208/393] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:54 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:54.232598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a0106c39-7689-4262-ab9d-0d592f83f9bf tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:54.233410 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a0106c39-7689-4262-ab9d-0d592f83f9bf tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:54.243879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0106c39-7689-4262-ab9d-0d592f83f9bf tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.244385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0106c39-7689-4262-ab9d-0d592f83f9bf tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.245192 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0106c39-7689-4262-ab9d-0d592f83f9bf tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.245624 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0106c39-7689-4262-ab9d-0d592f83f9bf tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.403382 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a0106c39-7689-4262-ab9d-0d592f83f9bf tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:54.416734 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a0106c39-7689-4262-ab9d-0d592f83f9bf tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.187716 Oct 28 08:41:54.417834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 209/394] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:54 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:54.600682 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-31fb9cd6-70e6-441b-9ca7-8a56945b9e80 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:54.601383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-31fb9cd6-70e6-441b-9ca7-8a56945b9e80 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:54.615928 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31fb9cd6-70e6-441b-9ca7-8a56945b9e80 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.616311 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31fb9cd6-70e6-441b-9ca7-8a56945b9e80 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.617076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31fb9cd6-70e6-441b-9ca7-8a56945b9e80 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.617516 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31fb9cd6-70e6-441b-9ca7-8a56945b9e80 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.757830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-31fb9cd6-70e6-441b-9ca7-8a56945b9e80 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:54.769873 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-31fb9cd6-70e6-441b-9ca7-8a56945b9e80 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.173833 Oct 28 08:41:54.770754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 210/395] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:54 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:54.795834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-69ccf4f7-6aae-4834-9cad-20bf7742a69c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:54.796431 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-69ccf4f7-6aae-4834-9cad-20bf7742a69c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:54.802816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69ccf4f7-6aae-4834-9cad-20bf7742a69c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.803263 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69ccf4f7-6aae-4834-9cad-20bf7742a69c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.804028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69ccf4f7-6aae-4834-9cad-20bf7742a69c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.804462 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69ccf4f7-6aae-4834-9cad-20bf7742a69c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.938077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-69ccf4f7-6aae-4834-9cad-20bf7742a69c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:54.945633 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-69ccf4f7-6aae-4834-9cad-20bf7742a69c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.153291 Oct 28 08:41:54.946236 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 211/396] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:54 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:55.033291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ed690ea1-4932-4784-b4cf-e74d62b65120 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:55.033291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ed690ea1-4932-4784-b4cf-e74d62b65120 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:55.039920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed690ea1-4932-4784-b4cf-e74d62b65120 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.040361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed690ea1-4932-4784-b4cf-e74d62b65120 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.041132 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed690ea1-4932-4784-b4cf-e74d62b65120 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.041563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed690ea1-4932-4784-b4cf-e74d62b65120 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.175351 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ed690ea1-4932-4784-b4cf-e74d62b65120 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:55.186060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ed690ea1-4932-4784-b4cf-e74d62b65120 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:55.187558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ed690ea1-4932-4784-b4cf-e74d62b65120 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:55.188738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ed690ea1-4932-4784-b4cf-e74d62b65120 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.160025 Oct 28 08:41:55.189330 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 212/397] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:55 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:41:55.246843 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dc9b8a94-17c4-49c9-bb48-6ee6d39cd118 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:55.247633 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dc9b8a94-17c4-49c9-bb48-6ee6d39cd118 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:55.255412 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dc9b8a94-17c4-49c9-bb48-6ee6d39cd118 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.255864 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dc9b8a94-17c4-49c9-bb48-6ee6d39cd118 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.256799 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dc9b8a94-17c4-49c9-bb48-6ee6d39cd118 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.257236 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dc9b8a94-17c4-49c9-bb48-6ee6d39cd118 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.409718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dc9b8a94-17c4-49c9-bb48-6ee6d39cd118 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:55.417208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dc9b8a94-17c4-49c9-bb48-6ee6d39cd118 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.175189 Oct 28 08:41:55.419467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 213/398] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:55 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:55.434758 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3e359c1c-8f99-4897-99a0-c57bde41cf14 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:55.435511 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3e359c1c-8f99-4897-99a0-c57bde41cf14 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:55.450218 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e359c1c-8f99-4897-99a0-c57bde41cf14 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.450807 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e359c1c-8f99-4897-99a0-c57bde41cf14 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.451724 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e359c1c-8f99-4897-99a0-c57bde41cf14 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.452240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e359c1c-8f99-4897-99a0-c57bde41cf14 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.613255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3e359c1c-8f99-4897-99a0-c57bde41cf14 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:55.622266 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3e359c1c-8f99-4897-99a0-c57bde41cf14 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.191094 Oct 28 08:41:55.622921 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 214/399] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:55 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:55.789108 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-49f5eacf-3182-4131-a4ed-570b624fa15c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:55.789823 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-49f5eacf-3182-4131-a4ed-570b624fa15c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:55.799960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-49f5eacf-3182-4131-a4ed-570b624fa15c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.799960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-49f5eacf-3182-4131-a4ed-570b624fa15c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.799960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-49f5eacf-3182-4131-a4ed-570b624fa15c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.799960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-49f5eacf-3182-4131-a4ed-570b624fa15c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.950625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-49f5eacf-3182-4131-a4ed-570b624fa15c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:55.965367 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-49f5eacf-3182-4131-a4ed-570b624fa15c tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.172865 Oct 28 08:41:55.966467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 215/400] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:55 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:55.970895 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e4c6e662-ce62-4a61-abcb-839f1acfa3dd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:55.971505 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e4c6e662-ce62-4a61-abcb-839f1acfa3dd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:55.978211 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e4c6e662-ce62-4a61-abcb-839f1acfa3dd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.978659 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e4c6e662-ce62-4a61-abcb-839f1acfa3dd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.979442 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e4c6e662-ce62-4a61-abcb-839f1acfa3dd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.980598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e4c6e662-ce62-4a61-abcb-839f1acfa3dd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.160191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e4c6e662-ce62-4a61-abcb-839f1acfa3dd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:56.168263 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e4c6e662-ce62-4a61-abcb-839f1acfa3dd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.200941 Oct 28 08:41:56.169064 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 216/401] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:55 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:56.206826 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-963b501a-3902-42a1-98cc-a29c322d4f62 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:56.209022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-963b501a-3902-42a1-98cc-a29c322d4f62 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:56.216666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-963b501a-3902-42a1-98cc-a29c322d4f62 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.217203 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-963b501a-3902-42a1-98cc-a29c322d4f62 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.218042 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-963b501a-3902-42a1-98cc-a29c322d4f62 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.218712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-963b501a-3902-42a1-98cc-a29c322d4f62 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.358135 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-963b501a-3902-42a1-98cc-a29c322d4f62 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:56.366303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-963b501a-3902-42a1-98cc-a29c322d4f62 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:56.367800 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-963b501a-3902-42a1-98cc-a29c322d4f62 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:56.368918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-963b501a-3902-42a1-98cc-a29c322d4f62 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.165806 Oct 28 08:41:56.369497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 217/402] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:56 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:56.438136 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-837b7621-9293-49c0-b510-f7e106b2af4e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:56.438816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-837b7621-9293-49c0-b510-f7e106b2af4e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:56.446556 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-837b7621-9293-49c0-b510-f7e106b2af4e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.447025 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-837b7621-9293-49c0-b510-f7e106b2af4e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.447976 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-837b7621-9293-49c0-b510-f7e106b2af4e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.448415 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-837b7621-9293-49c0-b510-f7e106b2af4e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.588074 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-837b7621-9293-49c0-b510-f7e106b2af4e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:56.595867 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-837b7621-9293-49c0-b510-f7e106b2af4e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.162612 Oct 28 08:41:56.596450 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 218/403] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:56 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:56.642391 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-de1bd28d-bdc0-4a33-bc72-71f6e44730ec tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:56.643359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-de1bd28d-bdc0-4a33-bc72-71f6e44730ec tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:56.650855 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de1bd28d-bdc0-4a33-bc72-71f6e44730ec tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.651298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de1bd28d-bdc0-4a33-bc72-71f6e44730ec tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.652075 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de1bd28d-bdc0-4a33-bc72-71f6e44730ec tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.652504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de1bd28d-bdc0-4a33-bc72-71f6e44730ec tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.788026 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-de1bd28d-bdc0-4a33-bc72-71f6e44730ec tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:56.796177 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-de1bd28d-bdc0-4a33-bc72-71f6e44730ec tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.159356 Oct 28 08:41:56.796872 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 219/404] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:56 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:56.983002 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bdf3cec4-449f-47ee-97a3-fbec026420c0 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:56.983598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bdf3cec4-449f-47ee-97a3-fbec026420c0 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:56.989679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bdf3cec4-449f-47ee-97a3-fbec026420c0 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.990146 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bdf3cec4-449f-47ee-97a3-fbec026420c0 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.990914 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bdf3cec4-449f-47ee-97a3-fbec026420c0 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.991345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bdf3cec4-449f-47ee-97a3-fbec026420c0 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.125063 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-bdf3cec4-449f-47ee-97a3-fbec026420c0 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:57.133820 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bdf3cec4-449f-47ee-97a3-fbec026420c0 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.154353 Oct 28 08:41:57.134564 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 220/405] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:56 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:57.185530 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-33243ad6-5f70-4a75-9eab-b04ed7466398 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:57.186150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-33243ad6-5f70-4a75-9eab-b04ed7466398 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:57.193243 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-33243ad6-5f70-4a75-9eab-b04ed7466398 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.193691 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-33243ad6-5f70-4a75-9eab-b04ed7466398 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.194536 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-33243ad6-5f70-4a75-9eab-b04ed7466398 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.194973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-33243ad6-5f70-4a75-9eab-b04ed7466398 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.327346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-33243ad6-5f70-4a75-9eab-b04ed7466398 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:57.336080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-33243ad6-5f70-4a75-9eab-b04ed7466398 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.154024 Oct 28 08:41:57.340620 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 221/406] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:57 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:57.387909 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-441b330f-5522-4113-b114-c8e165909e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:57.388499 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-441b330f-5522-4113-b114-c8e165909e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:57.394772 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-441b330f-5522-4113-b114-c8e165909e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.396432 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-441b330f-5522-4113-b114-c8e165909e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.397300 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-441b330f-5522-4113-b114-c8e165909e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.397664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-441b330f-5522-4113-b114-c8e165909e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.556172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-441b330f-5522-4113-b114-c8e165909e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:57.564766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-441b330f-5522-4113-b114-c8e165909e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:57.566312 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-441b330f-5522-4113-b114-c8e165909e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:57.568023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-441b330f-5522-4113-b114-c8e165909e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.183739 Oct 28 08:41:57.579267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 222/407] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:57 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:41:57.614313 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-169f8b84-44e2-4159-97a0-6b06f5b8ec8b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:57.615570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-169f8b84-44e2-4159-97a0-6b06f5b8ec8b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:57.621412 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-169f8b84-44e2-4159-97a0-6b06f5b8ec8b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.621958 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-169f8b84-44e2-4159-97a0-6b06f5b8ec8b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.622807 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-169f8b84-44e2-4159-97a0-6b06f5b8ec8b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.623341 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-169f8b84-44e2-4159-97a0-6b06f5b8ec8b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.810740 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-169f8b84-44e2-4159-97a0-6b06f5b8ec8b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:57.824314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-169f8b84-44e2-4159-97a0-6b06f5b8ec8b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.213948 Oct 28 08:41:57.825466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 223/408] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:57 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:57.835699 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-84bbfa2b-901a-470d-81d2-aa95767da2e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:57.836564 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-84bbfa2b-901a-470d-81d2-aa95767da2e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:57.851630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-84bbfa2b-901a-470d-81d2-aa95767da2e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.852280 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-84bbfa2b-901a-470d-81d2-aa95767da2e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.853437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-84bbfa2b-901a-470d-81d2-aa95767da2e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.854089 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-84bbfa2b-901a-470d-81d2-aa95767da2e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.999421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-84bbfa2b-901a-470d-81d2-aa95767da2e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:58.007377 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-84bbfa2b-901a-470d-81d2-aa95767da2e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.180666 Oct 28 08:41:58.008324 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 224/409] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:57 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:58.151558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e7662414-3d55-4cfd-bcad-00045880a25d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:58.152197 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e7662414-3d55-4cfd-bcad-00045880a25d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:58.158496 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e7662414-3d55-4cfd-bcad-00045880a25d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:58.158938 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e7662414-3d55-4cfd-bcad-00045880a25d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:58.159711 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e7662414-3d55-4cfd-bcad-00045880a25d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:58.160141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e7662414-3d55-4cfd-bcad-00045880a25d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:58.430454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e7662414-3d55-4cfd-bcad-00045880a25d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:58.437728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e7662414-3d55-4cfd-bcad-00045880a25d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.289958 Oct 28 08:41:58.438413 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 225/410] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:58 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:58.443903 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-848e69de-54b4-4632-a0f5-112f266819a4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:58.444514 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-848e69de-54b4-4632-a0f5-112f266819a4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:58.450703 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-848e69de-54b4-4632-a0f5-112f266819a4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:58.451194 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-848e69de-54b4-4632-a0f5-112f266819a4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:58.452356 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-848e69de-54b4-4632-a0f5-112f266819a4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:58.452786 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-848e69de-54b4-4632-a0f5-112f266819a4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:58.606864 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-848e69de-54b4-4632-a0f5-112f266819a4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:58.615922 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-848e69de-54b4-4632-a0f5-112f266819a4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.176213 Oct 28 08:41:58.617731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 226/411] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:58 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:58.623622 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-71370fd0-8473-41e7-903b-c7c72aad2e94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:58.624531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-71370fd0-8473-41e7-903b-c7c72aad2e94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:58.636523 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-71370fd0-8473-41e7-903b-c7c72aad2e94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:58.636966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-71370fd0-8473-41e7-903b-c7c72aad2e94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:58.638188 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-71370fd0-8473-41e7-903b-c7c72aad2e94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:58.638613 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-71370fd0-8473-41e7-903b-c7c72aad2e94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:58.778079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-71370fd0-8473-41e7-903b-c7c72aad2e94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:58.787021 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-71370fd0-8473-41e7-903b-c7c72aad2e94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:58.788611 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-71370fd0-8473-41e7-903b-c7c72aad2e94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:58.789950 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-71370fd0-8473-41e7-903b-c7c72aad2e94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.170766 Oct 28 08:41:58.797913 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 227/412] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:58 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:58.850158 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bbc08b39-3531-40d6-9bff-8723c04fe111 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:58.850855 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bbc08b39-3531-40d6-9bff-8723c04fe111 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:58.857108 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bbc08b39-3531-40d6-9bff-8723c04fe111 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:58.857538 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bbc08b39-3531-40d6-9bff-8723c04fe111 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:58.858413 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bbc08b39-3531-40d6-9bff-8723c04fe111 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:58.858848 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bbc08b39-3531-40d6-9bff-8723c04fe111 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:58.991138 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-bbc08b39-3531-40d6-9bff-8723c04fe111 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:58.999215 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bbc08b39-3531-40d6-9bff-8723c04fe111 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.153049 Oct 28 08:41:59.000167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 228/413] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:58 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:59.024957 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a3e3a06b-3d3a-4eec-962d-f52c57b8357a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:59.025556 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a3e3a06b-3d3a-4eec-962d-f52c57b8357a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:59.031458 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a3e3a06b-3d3a-4eec-962d-f52c57b8357a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:59.031896 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a3e3a06b-3d3a-4eec-962d-f52c57b8357a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:59.032680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a3e3a06b-3d3a-4eec-962d-f52c57b8357a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:59.033100 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a3e3a06b-3d3a-4eec-962d-f52c57b8357a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:59.227759 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a3e3a06b-3d3a-4eec-962d-f52c57b8357a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:59.235011 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a3e3a06b-3d3a-4eec-962d-f52c57b8357a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.214713 Oct 28 08:41:59.235581 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 229/414] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:59 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:59.456680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b6ceac76-8281-4577-b1d8-080a450df050 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:59.457395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b6ceac76-8281-4577-b1d8-080a450df050 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:59.463891 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b6ceac76-8281-4577-b1d8-080a450df050 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:59.464334 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b6ceac76-8281-4577-b1d8-080a450df050 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:59.465129 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b6ceac76-8281-4577-b1d8-080a450df050 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:59.465562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b6ceac76-8281-4577-b1d8-080a450df050 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:59.603963 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b6ceac76-8281-4577-b1d8-080a450df050 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:59.612301 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b6ceac76-8281-4577-b1d8-080a450df050 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.159879 Oct 28 08:41:59.612882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 230/415] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:59 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:59.633729 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0c2744df-9670-4c53-8da9-3c6257760953 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:59.634347 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0c2744df-9670-4c53-8da9-3c6257760953 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:59.640180 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c2744df-9670-4c53-8da9-3c6257760953 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:59.640617 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c2744df-9670-4c53-8da9-3c6257760953 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:59.641367 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c2744df-9670-4c53-8da9-3c6257760953 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:59.641808 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c2744df-9670-4c53-8da9-3c6257760953 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:59.779876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0c2744df-9670-4c53-8da9-3c6257760953 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:59.787840 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0c2744df-9670-4c53-8da9-3c6257760953 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.158000 Oct 28 08:41:59.788408 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 231/416] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:59 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:59.807920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-be20f5a3-7147-4782-8d00-e4db4352a66e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:59.808519 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-be20f5a3-7147-4782-8d00-e4db4352a66e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:59.815484 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be20f5a3-7147-4782-8d00-e4db4352a66e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:59.815937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be20f5a3-7147-4782-8d00-e4db4352a66e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:59.816995 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be20f5a3-7147-4782-8d00-e4db4352a66e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:59.817193 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be20f5a3-7147-4782-8d00-e4db4352a66e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:59.940512 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-be20f5a3-7147-4782-8d00-e4db4352a66e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:59.948726 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-be20f5a3-7147-4782-8d00-e4db4352a66e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:59.950209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-be20f5a3-7147-4782-8d00-e4db4352a66e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:59.951289 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-be20f5a3-7147-4782-8d00-e4db4352a66e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.146898 Oct 28 08:41:59.951838 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 232/417] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:41:59 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:42:00.017704 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-10561f83-978d-4a28-9e94-82e8b91ac377 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:00.018346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-10561f83-978d-4a28-9e94-82e8b91ac377 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:00.026067 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10561f83-978d-4a28-9e94-82e8b91ac377 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.026623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10561f83-978d-4a28-9e94-82e8b91ac377 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.027409 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10561f83-978d-4a28-9e94-82e8b91ac377 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.027824 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10561f83-978d-4a28-9e94-82e8b91ac377 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.157480 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-10561f83-978d-4a28-9e94-82e8b91ac377 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:00.165430 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-10561f83-978d-4a28-9e94-82e8b91ac377 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.151363 Oct 28 08:42:00.166031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 233/418] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:00 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:00.253289 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-89a392e6-e499-4425-aadd-3e2b1f19bac6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:00.253855 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-89a392e6-e499-4425-aadd-3e2b1f19bac6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:00.260291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89a392e6-e499-4425-aadd-3e2b1f19bac6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.260731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89a392e6-e499-4425-aadd-3e2b1f19bac6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.261550 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89a392e6-e499-4425-aadd-3e2b1f19bac6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.261946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89a392e6-e499-4425-aadd-3e2b1f19bac6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.405963 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-89a392e6-e499-4425-aadd-3e2b1f19bac6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:00.413945 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-89a392e6-e499-4425-aadd-3e2b1f19bac6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.164444 Oct 28 08:42:00.414513 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 234/419] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:00 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:00.630118 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9219bc9c-23f8-47de-8cda-6378ea801ba8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:00.630793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9219bc9c-23f8-47de-8cda-6378ea801ba8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:00.636697 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9219bc9c-23f8-47de-8cda-6378ea801ba8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.637135 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9219bc9c-23f8-47de-8cda-6378ea801ba8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.637917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9219bc9c-23f8-47de-8cda-6378ea801ba8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.638345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9219bc9c-23f8-47de-8cda-6378ea801ba8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.764700 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9219bc9c-23f8-47de-8cda-6378ea801ba8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:00.772890 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9219bc9c-23f8-47de-8cda-6378ea801ba8 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.146392 Oct 28 08:42:00.773460 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 235/420] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:00 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:00.804604 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ada5d443-8fd2-4d72-9e67-a9a779751ac4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:00.805217 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ada5d443-8fd2-4d72-9e67-a9a779751ac4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:00.811252 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ada5d443-8fd2-4d72-9e67-a9a779751ac4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.811695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ada5d443-8fd2-4d72-9e67-a9a779751ac4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.812475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ada5d443-8fd2-4d72-9e67-a9a779751ac4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.812905 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ada5d443-8fd2-4d72-9e67-a9a779751ac4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.937167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ada5d443-8fd2-4d72-9e67-a9a779751ac4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:00.945097 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ada5d443-8fd2-4d72-9e67-a9a779751ac4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.144351 Oct 28 08:42:00.945661 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 236/421] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:00 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:00.970082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7e295e8d-dfb8-4507-b274-df383240ba87 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:00.970682 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7e295e8d-dfb8-4507-b274-df383240ba87 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:00.976941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7e295e8d-dfb8-4507-b274-df383240ba87 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.977381 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7e295e8d-dfb8-4507-b274-df383240ba87 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.978173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7e295e8d-dfb8-4507-b274-df383240ba87 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.978630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7e295e8d-dfb8-4507-b274-df383240ba87 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.103972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-7e295e8d-dfb8-4507-b274-df383240ba87 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:01.111935 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-7e295e8d-dfb8-4507-b274-df383240ba87 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:01.113457 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-7e295e8d-dfb8-4507-b274-df383240ba87 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:01.114984 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7e295e8d-dfb8-4507-b274-df383240ba87 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.148618 Oct 28 08:42:01.115572 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 237/422] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:42:00 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:42:01.183790 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-37db0a8f-d6ae-4a3c-a4a4-8f758b07b65c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:01.184304 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-37db0a8f-d6ae-4a3c-a4a4-8f758b07b65c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:01.190365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-37db0a8f-d6ae-4a3c-a4a4-8f758b07b65c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.190842 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-37db0a8f-d6ae-4a3c-a4a4-8f758b07b65c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.191632 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-37db0a8f-d6ae-4a3c-a4a4-8f758b07b65c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.192832 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-37db0a8f-d6ae-4a3c-a4a4-8f758b07b65c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.314439 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-37db0a8f-d6ae-4a3c-a4a4-8f758b07b65c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:01.324058 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-37db0a8f-d6ae-4a3c-a4a4-8f758b07b65c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.143768 Oct 28 08:42:01.324659 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 238/423] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:01 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:01.430523 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3c0719a5-d1c5-4491-8e0c-6817da50af1e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:01.431145 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3c0719a5-d1c5-4491-8e0c-6817da50af1e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:01.437120 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3c0719a5-d1c5-4491-8e0c-6817da50af1e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.437507 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3c0719a5-d1c5-4491-8e0c-6817da50af1e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.438317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3c0719a5-d1c5-4491-8e0c-6817da50af1e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.438750 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3c0719a5-d1c5-4491-8e0c-6817da50af1e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.561372 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3c0719a5-d1c5-4491-8e0c-6817da50af1e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:01.569292 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3c0719a5-d1c5-4491-8e0c-6817da50af1e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.142634 Oct 28 08:42:01.569882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 239/424] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:01 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:01.790521 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-deff8149-4669-47f8-99c4-35a6ecb935cb tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:01.791176 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-deff8149-4669-47f8-99c4-35a6ecb935cb tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:01.797714 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-deff8149-4669-47f8-99c4-35a6ecb935cb tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.798165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-deff8149-4669-47f8-99c4-35a6ecb935cb tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.798924 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-deff8149-4669-47f8-99c4-35a6ecb935cb tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.799346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-deff8149-4669-47f8-99c4-35a6ecb935cb tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.929931 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-deff8149-4669-47f8-99c4-35a6ecb935cb tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:01.937066 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-deff8149-4669-47f8-99c4-35a6ecb935cb tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.151310 Oct 28 08:42:01.937621 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 240/425] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:01 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:01.962528 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c81db41c-ace8-4664-9051-64fab1cbec16 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:01.963041 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c81db41c-ace8-4664-9051-64fab1cbec16 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:01.969018 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c81db41c-ace8-4664-9051-64fab1cbec16 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.969497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c81db41c-ace8-4664-9051-64fab1cbec16 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.970293 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c81db41c-ace8-4664-9051-64fab1cbec16 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.970728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c81db41c-ace8-4664-9051-64fab1cbec16 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.095950 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c81db41c-ace8-4664-9051-64fab1cbec16 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:02.104383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c81db41c-ace8-4664-9051-64fab1cbec16 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.146486 Oct 28 08:42:02.104975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 241/426] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:01 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:02.132144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b19e6e56-c171-4b03-b3bc-41b9be25535c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:02.132738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b19e6e56-c171-4b03-b3bc-41b9be25535c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:02.138728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b19e6e56-c171-4b03-b3bc-41b9be25535c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.139173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b19e6e56-c171-4b03-b3bc-41b9be25535c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.139931 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b19e6e56-c171-4b03-b3bc-41b9be25535c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.140358 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b19e6e56-c171-4b03-b3bc-41b9be25535c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.264530 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b19e6e56-c171-4b03-b3bc-41b9be25535c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:02.273077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b19e6e56-c171-4b03-b3bc-41b9be25535c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:02.274603 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b19e6e56-c171-4b03-b3bc-41b9be25535c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:02.275742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b19e6e56-c171-4b03-b3bc-41b9be25535c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.147269 Oct 28 08:42:02.276272 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 242/427] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:42:02 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:42:02.341541 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-10b5767a-5294-4b3d-a111-f9104608fc78 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:02.342325 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-10b5767a-5294-4b3d-a111-f9104608fc78 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:02.348130 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10b5767a-5294-4b3d-a111-f9104608fc78 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.348868 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10b5767a-5294-4b3d-a111-f9104608fc78 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.349523 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10b5767a-5294-4b3d-a111-f9104608fc78 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.350422 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10b5767a-5294-4b3d-a111-f9104608fc78 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.456611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ec5271a8-2728-4778-b23d-9ab761203186 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 17.172741 Oct 28 08:42:02.457047 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 186/428] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:45 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 17175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:02.581837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-10b5767a-5294-4b3d-a111-f9104608fc78 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:02.587336 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9d34920f-5ee4-4796-8e40-db1f61a91668 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:02.588288 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9d34920f-5ee4-4796-8e40-db1f61a91668 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:02.591492 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-10b5767a-5294-4b3d-a111-f9104608fc78 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.253480 Oct 28 08:42:02.601259 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 243/429] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:02 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:02.605095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d34920f-5ee4-4796-8e40-db1f61a91668 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.605564 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d34920f-5ee4-4796-8e40-db1f61a91668 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.606374 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d34920f-5ee4-4796-8e40-db1f61a91668 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.606804 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d34920f-5ee4-4796-8e40-db1f61a91668 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.807834 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9d34920f-5ee4-4796-8e40-db1f61a91668 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:02.815880 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9d34920f-5ee4-4796-8e40-db1f61a91668 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.233446 Oct 28 08:42:02.816456 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 187/430] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:02 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:02.955642 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6d55048d-98ef-4231-883d-deda04013733 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:02.957311 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6d55048d-98ef-4231-883d-deda04013733 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:02.965298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d55048d-98ef-4231-883d-deda04013733 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.965951 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d55048d-98ef-4231-883d-deda04013733 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.966979 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d55048d-98ef-4231-883d-deda04013733 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.967414 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d55048d-98ef-4231-883d-deda04013733 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:03.098758 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6d55048d-98ef-4231-883d-deda04013733 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:03.106356 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6d55048d-98ef-4231-883d-deda04013733 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.154582 Oct 28 08:42:03.106951 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 244/431] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:02 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:03.125018 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-06cc064b-809f-40b2-9c89-d40f3f1ac2bd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:03.125633 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-06cc064b-809f-40b2-9c89-d40f3f1ac2bd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:03.132822 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-06cc064b-809f-40b2-9c89-d40f3f1ac2bd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:03.133259 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-06cc064b-809f-40b2-9c89-d40f3f1ac2bd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:03.134043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-06cc064b-809f-40b2-9c89-d40f3f1ac2bd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:03.134471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-06cc064b-809f-40b2-9c89-d40f3f1ac2bd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:03.276809 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-06cc064b-809f-40b2-9c89-d40f3f1ac2bd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:03.284016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-06cc064b-809f-40b2-9c89-d40f3f1ac2bd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.163456 Oct 28 08:42:03.284577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 188/432] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:03 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:03.294044 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9d42bbd3-917c-45e3-ae84-19538998247c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:03.294697 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9d42bbd3-917c-45e3-ae84-19538998247c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:03.300519 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9d42bbd3-917c-45e3-ae84-19538998247c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:03.300960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9d42bbd3-917c-45e3-ae84-19538998247c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:03.301764 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9d42bbd3-917c-45e3-ae84-19538998247c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:03.302310 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9d42bbd3-917c-45e3-ae84-19538998247c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:03.436842 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9d42bbd3-917c-45e3-ae84-19538998247c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:03.445992 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9d42bbd3-917c-45e3-ae84-19538998247c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:03.447475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9d42bbd3-917c-45e3-ae84-19538998247c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:03.448575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9d42bbd3-917c-45e3-ae84-19538998247c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.158244 Oct 28 08:42:03.459126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 245/433] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:42:03 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:42:03.468853 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e7d1110b-a63d-4591-98c4-2ce55c9e6025 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:03.470127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e7d1110b-a63d-4591-98c4-2ce55c9e6025 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:03.477709 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7d1110b-a63d-4591-98c4-2ce55c9e6025 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:03.478277 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7d1110b-a63d-4591-98c4-2ce55c9e6025 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:03.479134 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7d1110b-a63d-4591-98c4-2ce55c9e6025 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:03.479670 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7d1110b-a63d-4591-98c4-2ce55c9e6025 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:03.610662 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-316ca333-b7e3-4019-9e6d-46b107aa3d7e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:03.611394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-316ca333-b7e3-4019-9e6d-46b107aa3d7e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:03.623048 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-316ca333-b7e3-4019-9e6d-46b107aa3d7e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:03.623842 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-316ca333-b7e3-4019-9e6d-46b107aa3d7e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:03.625218 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-316ca333-b7e3-4019-9e6d-46b107aa3d7e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:03.625831 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-316ca333-b7e3-4019-9e6d-46b107aa3d7e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:03.633896 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e7d1110b-a63d-4591-98c4-2ce55c9e6025 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.168765 Oct 28 08:42:03.634578 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 189/434] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:03 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:03.833992 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4b88d0ca-4fb6-4d49-ae39-2e07f513b728 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:03.842512 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4b88d0ca-4fb6-4d49-ae39-2e07f513b728 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:03.857104 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b88d0ca-4fb6-4d49-ae39-2e07f513b728 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:03.857891 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b88d0ca-4fb6-4d49-ae39-2e07f513b728 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:03.858913 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b88d0ca-4fb6-4d49-ae39-2e07f513b728 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:03.859558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b88d0ca-4fb6-4d49-ae39-2e07f513b728 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.211122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-316ca333-b7e3-4019-9e6d-46b107aa3d7e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:04.216398 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4b88d0ca-4fb6-4d49-ae39-2e07f513b728 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:04.218945 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-316ca333-b7e3-4019-9e6d-46b107aa3d7e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.614277 Oct 28 08:42:04.219608 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 246/435] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:03 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:04.224227 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4b88d0ca-4fb6-4d49-ae39-2e07f513b728 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.395298 Oct 28 08:42:04.224365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-42eaad83-0826-4fd4-b06b-5490886af000 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:04.224791 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 190/436] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:03 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:04.224978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-42eaad83-0826-4fd4-b06b-5490886af000 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:04.230918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-42eaad83-0826-4fd4-b06b-5490886af000 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.231254 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-42eaad83-0826-4fd4-b06b-5490886af000 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.232020 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-42eaad83-0826-4fd4-b06b-5490886af000 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.232619 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-42eaad83-0826-4fd4-b06b-5490886af000 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.300608 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4fbc1bd4-ddeb-484d-88fc-6f4f67aa07d4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:04.301223 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4fbc1bd4-ddeb-484d-88fc-6f4f67aa07d4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:04.311230 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4fbc1bd4-ddeb-484d-88fc-6f4f67aa07d4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.312773 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4fbc1bd4-ddeb-484d-88fc-6f4f67aa07d4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.313619 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4fbc1bd4-ddeb-484d-88fc-6f4f67aa07d4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.314089 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4fbc1bd4-ddeb-484d-88fc-6f4f67aa07d4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.534889 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-42eaad83-0826-4fd4-b06b-5490886af000 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:04.543500 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-42eaad83-0826-4fd4-b06b-5490886af000 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.322955 Oct 28 08:42:04.544283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 247/437] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:04 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:04.559842 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-eba9a995-6893-49e1-8d6f-173ab6f71a69 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:04.560684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-eba9a995-6893-49e1-8d6f-173ab6f71a69 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:04.575470 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eba9a995-6893-49e1-8d6f-173ab6f71a69 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.576039 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eba9a995-6893-49e1-8d6f-173ab6f71a69 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.576923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eba9a995-6893-49e1-8d6f-173ab6f71a69 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.577429 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eba9a995-6893-49e1-8d6f-173ab6f71a69 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.708632 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4fbc1bd4-ddeb-484d-88fc-6f4f67aa07d4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:04.719893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4fbc1bd4-ddeb-484d-88fc-6f4f67aa07d4 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.422421 Oct 28 08:42:04.720649 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 191/438] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:04 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:04.730274 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-06294f79-667b-49fd-b5c4-c6a413224e78 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:04.731285 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-06294f79-667b-49fd-b5c4-c6a413224e78 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:04.738233 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-06294f79-667b-49fd-b5c4-c6a413224e78 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.738967 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-06294f79-667b-49fd-b5c4-c6a413224e78 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.739834 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-06294f79-667b-49fd-b5c4-c6a413224e78 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.740427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-06294f79-667b-49fd-b5c4-c6a413224e78 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.841556 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-06294f79-667b-49fd-b5c4-c6a413224e78 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.119417 Oct 28 08:42:04.845619 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 192/439] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:04 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:04.861399 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-eba9a995-6893-49e1-8d6f-173ab6f71a69 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:04.869841 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-eba9a995-6893-49e1-8d6f-173ab6f71a69 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:04.871370 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-eba9a995-6893-49e1-8d6f-173ab6f71a69 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:04.872502 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-eba9a995-6893-49e1-8d6f-173ab6f71a69 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1405 microversion: 2.20 time: 0.325690 Oct 28 08:42:04.873061 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 248/440] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:42:04 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1405 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:42:05.237174 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-48ff83d8-86db-43e5-bd90-f07caa10130d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:05.237804 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-48ff83d8-86db-43e5-bd90-f07caa10130d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:05.240504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2132cb5a-b9ea-423b-ab73-85dfaff30860 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:05.241103 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2132cb5a-b9ea-423b-ab73-85dfaff30860 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:05.245528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-48ff83d8-86db-43e5-bd90-f07caa10130d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.246018 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-48ff83d8-86db-43e5-bd90-f07caa10130d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.246869 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-48ff83d8-86db-43e5-bd90-f07caa10130d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.247272 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-48ff83d8-86db-43e5-bd90-f07caa10130d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.247752 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2132cb5a-b9ea-423b-ab73-85dfaff30860 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.248198 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2132cb5a-b9ea-423b-ab73-85dfaff30860 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.248972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2132cb5a-b9ea-423b-ab73-85dfaff30860 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.249393 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2132cb5a-b9ea-423b-ab73-85dfaff30860 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.430844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-48ff83d8-86db-43e5-bd90-f07caa10130d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:05.436269 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2132cb5a-b9ea-423b-ab73-85dfaff30860 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:05.438839 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-48ff83d8-86db-43e5-bd90-f07caa10130d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.205755 Oct 28 08:42:05.439525 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 193/441] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:05 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:05.444506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2132cb5a-b9ea-423b-ab73-85dfaff30860 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.207665 Oct 28 08:42:05.445245 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 249/442] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:05 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:05.560566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-13ea6854-9640-4181-ab05-b42544051601 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:05.561180 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-13ea6854-9640-4181-ab05-b42544051601 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:05.568043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-13ea6854-9640-4181-ab05-b42544051601 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.568486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-13ea6854-9640-4181-ab05-b42544051601 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.569264 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-13ea6854-9640-4181-ab05-b42544051601 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.569697 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-13ea6854-9640-4181-ab05-b42544051601 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.705161 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-13ea6854-9640-4181-ab05-b42544051601 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:05.714407 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-13ea6854-9640-4181-ab05-b42544051601 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1314 microversion: 2.1 time: 0.157430 Oct 28 08:42:05.716563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 194/443] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:05 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:05.737658 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d506b659-fcb4-4ee2-98af-fcabc89a22e2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:05.738283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d506b659-fcb4-4ee2-98af-fcabc89a22e2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:05.744271 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d506b659-fcb4-4ee2-98af-fcabc89a22e2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.744838 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d506b659-fcb4-4ee2-98af-fcabc89a22e2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.745460 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d506b659-fcb4-4ee2-98af-fcabc89a22e2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.745925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d506b659-fcb4-4ee2-98af-fcabc89a22e2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.854062 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-49c0637f-ab13-4507-abbc-6efeafb1b45b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:05.855082 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-49c0637f-ab13-4507-abbc-6efeafb1b45b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:05.874001 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49c0637f-ab13-4507-abbc-6efeafb1b45b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.874431 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49c0637f-ab13-4507-abbc-6efeafb1b45b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.875403 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49c0637f-ab13-4507-abbc-6efeafb1b45b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.875995 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49c0637f-ab13-4507-abbc-6efeafb1b45b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.887784 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d506b659-fcb4-4ee2-98af-fcabc89a22e2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:05.897145 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d506b659-fcb4-4ee2-98af-fcabc89a22e2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.162189 Oct 28 08:42:05.897966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 250/444] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:05 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:05.902486 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-138ce96f-5f10-4049-ba59-82ed80a4db8f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:05.903221 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-138ce96f-5f10-4049-ba59-82ed80a4db8f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:05.909542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-138ce96f-5f10-4049-ba59-82ed80a4db8f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.910531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-138ce96f-5f10-4049-ba59-82ed80a4db8f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.912047 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-138ce96f-5f10-4049-ba59-82ed80a4db8f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.912585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-138ce96f-5f10-4049-ba59-82ed80a4db8f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.049296 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-138ce96f-5f10-4049-ba59-82ed80a4db8f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:06.058005 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-138ce96f-5f10-4049-ba59-82ed80a4db8f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:06.059497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-138ce96f-5f10-4049-ba59-82ed80a4db8f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:06.060642 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-138ce96f-5f10-4049-ba59-82ed80a4db8f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1596 microversion: 2.20 time: 0.161705 Oct 28 08:42:06.061197 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 251/445] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:42:05 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1596 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:42:06.085881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-89ca112a-29c5-442b-80f2-3e7ca7087a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:06.086284 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-89ca112a-29c5-442b-80f2-3e7ca7087a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:06.092188 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89ca112a-29c5-442b-80f2-3e7ca7087a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.092629 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89ca112a-29c5-442b-80f2-3e7ca7087a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.093399 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89ca112a-29c5-442b-80f2-3e7ca7087a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.093862 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89ca112a-29c5-442b-80f2-3e7ca7087a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.121265 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-49c0637f-ab13-4507-abbc-6efeafb1b45b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.271544 Oct 28 08:42:06.122081 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 195/446] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:05 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:06.178913 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-89ca112a-29c5-442b-80f2-3e7ca7087a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097301 Oct 28 08:42:06.179521 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 252/447] 10.222.0.74 () {60 vars in 1315 bytes} [Thu Oct 28 08:42:06 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:06.456746 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1a482dee-32dc-4f94-bf5b-aa3e72756d5f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:06.457375 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1a482dee-32dc-4f94-bf5b-aa3e72756d5f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:06.461625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8f6c6bcb-7c34-41a0-b6e7-9a84d3c52b91 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:06.462845 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8f6c6bcb-7c34-41a0-b6e7-9a84d3c52b91 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:06.465285 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1a482dee-32dc-4f94-bf5b-aa3e72756d5f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.465735 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1a482dee-32dc-4f94-bf5b-aa3e72756d5f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.466545 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1a482dee-32dc-4f94-bf5b-aa3e72756d5f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.466975 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1a482dee-32dc-4f94-bf5b-aa3e72756d5f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.468612 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8f6c6bcb-7c34-41a0-b6e7-9a84d3c52b91 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.469098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8f6c6bcb-7c34-41a0-b6e7-9a84d3c52b91 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.469889 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8f6c6bcb-7c34-41a0-b6e7-9a84d3c52b91 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.470317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8f6c6bcb-7c34-41a0-b6e7-9a84d3c52b91 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.995222 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1a482dee-32dc-4f94-bf5b-aa3e72756d5f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:07.003210 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1a482dee-32dc-4f94-bf5b-aa3e72756d5f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.550512 Oct 28 08:42:07.003815 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 196/448] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:06 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:07.007630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8f6c6bcb-7c34-41a0-b6e7-9a84d3c52b91 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:07.016081 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8f6c6bcb-7c34-41a0-b6e7-9a84d3c52b91 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.559679 Oct 28 08:42:07.016933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 253/449] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:06 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:07.023233 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3946af10-6f42-48d0-9e43-805a850e8ef5 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:07.023712 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-727725ba-982f-4e4d-98f0-d4144408c7e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:07.024294 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3946af10-6f42-48d0-9e43-805a850e8ef5 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:07.025087 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-727725ba-982f-4e4d-98f0-d4144408c7e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:07.032369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3946af10-6f42-48d0-9e43-805a850e8ef5 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.033196 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3946af10-6f42-48d0-9e43-805a850e8ef5 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.034247 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3946af10-6f42-48d0-9e43-805a850e8ef5 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.034859 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3946af10-6f42-48d0-9e43-805a850e8ef5 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.039865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-727725ba-982f-4e4d-98f0-d4144408c7e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.041150 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-727725ba-982f-4e4d-98f0-d4144408c7e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.042568 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-727725ba-982f-4e4d-98f0-d4144408c7e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.043295 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-727725ba-982f-4e4d-98f0-d4144408c7e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.614345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3946af10-6f42-48d0-9e43-805a850e8ef5 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:07.621612 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3946af10-6f42-48d0-9e43-805a850e8ef5 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.603529 Oct 28 08:42:07.622206 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 254/450] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:07 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:07.626569 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c62812ca-911b-43a0-8001-e46beffe0145 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:07.627552 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c62812ca-911b-43a0-8001-e46beffe0145 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:07.632890 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-727725ba-982f-4e4d-98f0-d4144408c7e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:07.638322 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c62812ca-911b-43a0-8001-e46beffe0145 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.638776 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c62812ca-911b-43a0-8001-e46beffe0145 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.639556 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c62812ca-911b-43a0-8001-e46beffe0145 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.640043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-727725ba-982f-4e4d-98f0-d4144408c7e7 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1498 microversion: 2.1 time: 0.635160 Oct 28 08:42:07.640184 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c62812ca-911b-43a0-8001-e46beffe0145 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.640617 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 197/451] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:07 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1498 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:07.943682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-326bdb85-8c47-464e-a336-42bd8f433ecb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:07.944598 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-326bdb85-8c47-464e-a336-42bd8f433ecb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:07.950562 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-326bdb85-8c47-464e-a336-42bd8f433ecb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.951001 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-326bdb85-8c47-464e-a336-42bd8f433ecb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.951835 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-326bdb85-8c47-464e-a336-42bd8f433ecb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.952270 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-326bdb85-8c47-464e-a336-42bd8f433ecb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:10.862514 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c62812ca-911b-43a0-8001-e46beffe0145 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 3.239033 Oct 28 08:42:10.864285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 255/452] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:07 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 3241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:10.869655 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-326bdb85-8c47-464e-a336-42bd8f433ecb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 14 microversion: 2.20 time: 2.929628 Oct 28 08:42:10.870483 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-97b1c129-5bad-43e3-a72c-e960f100cc74 req-33dff995-a796-4cf6-912e-e5cb62777a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423157c3-a1e9-43c5-8fda-01d1d93bd484", "tag": "2e8c6f82-a258-4342-aacf-0b4e80ccd12e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:10.872399 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:10.872399 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:42:10.879442 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 198/453] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:07 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 14 bytes in 2940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:10.886721 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-97b1c129-5bad-43e3-a72c-e960f100cc74 req-33dff995-a796-4cf6-912e-e5cb62777a57 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:10.887929 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-97b1c129-5bad-43e3-a72c-e960f100cc74 req-33dff995-a796-4cf6-912e-e5cb62777a57 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:10.889937 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0bec1f91-8c9c-41fb-8de5-209fa2f49ef6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:10.890947 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0bec1f91-8c9c-41fb-8de5-209fa2f49ef6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:10.900919 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0bec1f91-8c9c-41fb-8de5-209fa2f49ef6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:10.901700 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0bec1f91-8c9c-41fb-8de5-209fa2f49ef6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:10.902914 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0bec1f91-8c9c-41fb-8de5-209fa2f49ef6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:10.903752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0bec1f91-8c9c-41fb-8de5-209fa2f49ef6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:10.905972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-97b1c129-5bad-43e3-a72c-e960f100cc74 req-33dff995-a796-4cf6-912e-e5cb62777a57 service nova] Creating event network-changed:2e8c6f82-a258-4342-aacf-0b4e80ccd12e for instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 on hv-cinder-81566 Oct 28 08:42:10.914732 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-97b1c129-5bad-43e3-a72c-e960f100cc74 req-33dff995-a796-4cf6-912e-e5cb62777a57 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047931 Oct 28 08:42:10.915578 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 256/454] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:10.921646 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-510864cc-2feb-424f-9564-05e8b46f49c3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:10.923665 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-510864cc-2feb-424f-9564-05e8b46f49c3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:10.941675 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-510864cc-2feb-424f-9564-05e8b46f49c3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:10.942780 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-510864cc-2feb-424f-9564-05e8b46f49c3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:10.944602 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-510864cc-2feb-424f-9564-05e8b46f49c3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:10.945173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-510864cc-2feb-424f-9564-05e8b46f49c3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.234834 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0bec1f91-8c9c-41fb-8de5-209fa2f49ef6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:11.242729 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-510864cc-2feb-424f-9564-05e8b46f49c3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:11.243818 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0bec1f91-8c9c-41fb-8de5-209fa2f49ef6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.362642 Oct 28 08:42:11.246362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 199/455] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:10 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:11.249509 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a3c3a40f-9b56-43f7-a016-27dfaf030457 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:11.250400 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a3c3a40f-9b56-43f7-a016-27dfaf030457 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:11.256252 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-510864cc-2feb-424f-9564-05e8b46f49c3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.339254 Oct 28 08:42:11.258380 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 257/456] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:10 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:11.258890 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a3c3a40f-9b56-43f7-a016-27dfaf030457 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:11.259336 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a3c3a40f-9b56-43f7-a016-27dfaf030457 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.260228 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a3c3a40f-9b56-43f7-a016-27dfaf030457 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:11.260638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a3c3a40f-9b56-43f7-a016-27dfaf030457 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.538559 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a3c3a40f-9b56-43f7-a016-27dfaf030457 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:11.544863 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-cc88ddcd-0ce5-45c4-a917-9aafb3a16829 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:11.545635 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-cc88ddcd-0ce5-45c4-a917-9aafb3a16829 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:11.546056 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a3c3a40f-9b56-43f7-a016-27dfaf030457 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.300215 Oct 28 08:42:11.546956 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 200/457] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:11 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:11.552314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cc88ddcd-0ce5-45c4-a917-9aafb3a16829 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:11.552751 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cc88ddcd-0ce5-45c4-a917-9aafb3a16829 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.553755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cc88ddcd-0ce5-45c4-a917-9aafb3a16829 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:11.554000 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cc88ddcd-0ce5-45c4-a917-9aafb3a16829 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.581473 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-cc88ddcd-0ce5-45c4-a917-9aafb3a16829 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Going to try to terminate instance {{(pid=132797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:42:11.678179 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-cc88ddcd-0ce5-45c4-a917-9aafb3a16829 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "DELETE /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 204 len: 0 microversion: 2.1 time: 0.136523 Oct 28 08:42:11.684784 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 258/458] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:42:11 2021] DELETE /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 08:42:11.694263 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e751ec03-0ea9-4e83-a59b-b9e0f9014eaf tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:11.694263 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e751ec03-0ea9-4e83-a59b-b9e0f9014eaf tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:11.701443 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e751ec03-0ea9-4e83-a59b-b9e0f9014eaf tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:11.702083 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e751ec03-0ea9-4e83-a59b-b9e0f9014eaf tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.703008 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e751ec03-0ea9-4e83-a59b-b9e0f9014eaf tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:11.703724 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e751ec03-0ea9-4e83-a59b-b9e0f9014eaf tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.876718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a76d7f61-1183-42a2-ab9e-2f0b9a2253dd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:11.877753 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a76d7f61-1183-42a2-ab9e-2f0b9a2253dd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:11.893760 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a76d7f61-1183-42a2-ab9e-2f0b9a2253dd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:11.894318 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a76d7f61-1183-42a2-ab9e-2f0b9a2253dd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.897142 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a76d7f61-1183-42a2-ab9e-2f0b9a2253dd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:11.897581 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a76d7f61-1183-42a2-ab9e-2f0b9a2253dd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.915042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e751ec03-0ea9-4e83-a59b-b9e0f9014eaf tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:11.924794 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e751ec03-0ea9-4e83-a59b-b9e0f9014eaf tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1504 microversion: 2.1 time: 0.238689 Oct 28 08:42:11.925887 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 201/459] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:11 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:11.938741 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ad99b689-50b6-4eda-aa41-8695f7accbf1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:11.939769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ad99b689-50b6-4eda-aa41-8695f7accbf1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:11.946463 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad99b689-50b6-4eda-aa41-8695f7accbf1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:11.946883 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad99b689-50b6-4eda-aa41-8695f7accbf1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.947940 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad99b689-50b6-4eda-aa41-8695f7accbf1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:11.948373 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad99b689-50b6-4eda-aa41-8695f7accbf1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:11.971751 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a76d7f61-1183-42a2-ab9e-2f0b9a2253dd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.100023 Oct 28 08:42:11.972414 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 259/460] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:11 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:12.090274 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ad99b689-50b6-4eda-aa41-8695f7accbf1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 14 microversion: 2.20 time: 0.162552 Oct 28 08:42:12.090707 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 202/461] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:11 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:12.266491 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b8fa5a9b-e984-4cca-9c0d-0c0497987de0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:12.266491 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b8fa5a9b-e984-4cca-9c0d-0c0497987de0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:12.273074 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8fa5a9b-e984-4cca-9c0d-0c0497987de0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.273518 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8fa5a9b-e984-4cca-9c0d-0c0497987de0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.274307 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8fa5a9b-e984-4cca-9c0d-0c0497987de0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.274756 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8fa5a9b-e984-4cca-9c0d-0c0497987de0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.293779 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-205fb131-c729-46d6-8167-0af3d334ef5b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:12.294685 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-205fb131-c729-46d6-8167-0af3d334ef5b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:12.302913 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-205fb131-c729-46d6-8167-0af3d334ef5b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.303420 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-205fb131-c729-46d6-8167-0af3d334ef5b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.304460 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-205fb131-c729-46d6-8167-0af3d334ef5b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.305002 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-205fb131-c729-46d6-8167-0af3d334ef5b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.478627 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b8fa5a9b-e984-4cca-9c0d-0c0497987de0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:12.485746 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-205fb131-c729-46d6-8167-0af3d334ef5b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:12.488478 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b8fa5a9b-e984-4cca-9c0d-0c0497987de0 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.229716 Oct 28 08:42:12.489128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 260/462] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:12 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:12.493679 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-205fb131-c729-46d6-8167-0af3d334ef5b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.210874 Oct 28 08:42:12.498294 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 203/463] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:12 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:12.563082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-aa3538e7-da7d-4310-a4bc-c968c4893824 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:12.563687 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-aa3538e7-da7d-4310-a4bc-c968c4893824 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:12.570917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aa3538e7-da7d-4310-a4bc-c968c4893824 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.571361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aa3538e7-da7d-4310-a4bc-c968c4893824 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.572129 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aa3538e7-da7d-4310-a4bc-c968c4893824 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.572561 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aa3538e7-da7d-4310-a4bc-c968c4893824 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.697873 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-aa3538e7-da7d-4310-a4bc-c968c4893824 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:12.705094 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-aa3538e7-da7d-4310-a4bc-c968c4893824 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.145843 Oct 28 08:42:12.705643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 261/464] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:12 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:12.943871 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ad52d468-52c3-44ae-9e42-00df54a6ab56 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:12.944386 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ad52d468-52c3-44ae-9e42-00df54a6ab56 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:12.950735 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad52d468-52c3-44ae-9e42-00df54a6ab56 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.951247 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad52d468-52c3-44ae-9e42-00df54a6ab56 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.952001 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad52d468-52c3-44ae-9e42-00df54a6ab56 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.952437 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad52d468-52c3-44ae-9e42-00df54a6ab56 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.983779 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-353ab3bb-3be5-4bb9-9c2a-e5b19fdea864 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:12.984959 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-353ab3bb-3be5-4bb9-9c2a-e5b19fdea864 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:12.992141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-353ab3bb-3be5-4bb9-9c2a-e5b19fdea864 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.992588 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-353ab3bb-3be5-4bb9-9c2a-e5b19fdea864 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.993360 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-353ab3bb-3be5-4bb9-9c2a-e5b19fdea864 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.993851 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-353ab3bb-3be5-4bb9-9c2a-e5b19fdea864 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:13.092126 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ad52d468-52c3-44ae-9e42-00df54a6ab56 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:13.101535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ad52d468-52c3-44ae-9e42-00df54a6ab56 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1504 microversion: 2.1 time: 0.162423 Oct 28 08:42:13.102246 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 204/465] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:12 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:13.106924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-810dbd90-aff9-4ecb-a63a-e21de5eef11b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:13.107885 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-810dbd90-aff9-4ecb-a63a-e21de5eef11b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:13.113693 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-810dbd90-aff9-4ecb-a63a-e21de5eef11b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:13.114297 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-810dbd90-aff9-4ecb-a63a-e21de5eef11b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:13.115077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-810dbd90-aff9-4ecb-a63a-e21de5eef11b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:13.115512 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-810dbd90-aff9-4ecb-a63a-e21de5eef11b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:17.119784 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-810dbd90-aff9-4ecb-a63a-e21de5eef11b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 14 microversion: 2.20 time: 4.016067 Oct 28 08:42:17.120576 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 205/466] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:13 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 14 bytes in 4018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:17.125648 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-808732a5-b647-4616-bd58-935fc68b1317 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:17.126379 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-808732a5-b647-4616-bd58-935fc68b1317 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:17.134803 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-808732a5-b647-4616-bd58-935fc68b1317 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:17.135353 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-808732a5-b647-4616-bd58-935fc68b1317 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:17.136220 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-808732a5-b647-4616-bd58-935fc68b1317 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:17.136825 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-808732a5-b647-4616-bd58-935fc68b1317 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:17.271202 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-808732a5-b647-4616-bd58-935fc68b1317 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:17.278973 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-808732a5-b647-4616-bd58-935fc68b1317 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1508 microversion: 2.1 time: 0.157084 Oct 28 08:42:17.279528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 206/467] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:17 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:17.283687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0f8ec6e8-4403-4f60-8058-bda924dcf1e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:17.284281 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0f8ec6e8-4403-4f60-8058-bda924dcf1e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:17.290140 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f8ec6e8-4403-4f60-8058-bda924dcf1e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:17.290583 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f8ec6e8-4403-4f60-8058-bda924dcf1e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:17.291343 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f8ec6e8-4403-4f60-8058-bda924dcf1e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:17.291776 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f8ec6e8-4403-4f60-8058-bda924dcf1e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:17.320417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-353ab3bb-3be5-4bb9-9c2a-e5b19fdea864 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 4.340028 Oct 28 08:42:17.321483 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 262/468] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:12 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 4342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:17.326625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-60c0edd7-2eaf-42e9-99d7-55d5cb89879a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:17.327326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-60c0edd7-2eaf-42e9-99d7-55d5cb89879a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:17.334945 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-60c0edd7-2eaf-42e9-99d7-55d5cb89879a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:17.335395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-60c0edd7-2eaf-42e9-99d7-55d5cb89879a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:17.336173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-60c0edd7-2eaf-42e9-99d7-55d5cb89879a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:17.336606 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-60c0edd7-2eaf-42e9-99d7-55d5cb89879a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:17.453313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0f8ec6e8-4403-4f60-8058-bda924dcf1e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:17.462864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0f8ec6e8-4403-4f60-8058-bda924dcf1e3 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.181955 Oct 28 08:42:17.463832 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 207/469] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:17 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:17.471313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-38c28689-377d-4673-8aaa-08c3b09fc344 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:17.472208 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-38c28689-377d-4673-8aaa-08c3b09fc344 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:17.480151 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38c28689-377d-4673-8aaa-08c3b09fc344 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:17.480685 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38c28689-377d-4673-8aaa-08c3b09fc344 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:17.481462 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38c28689-377d-4673-8aaa-08c3b09fc344 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:17.481927 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38c28689-377d-4673-8aaa-08c3b09fc344 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:17.509727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-60c0edd7-2eaf-42e9-99d7-55d5cb89879a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:17.517717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-60c0edd7-2eaf-42e9-99d7-55d5cb89879a tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.194953 Oct 28 08:42:17.518326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 263/470] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:17 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:17.612251 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-38c28689-377d-4673-8aaa-08c3b09fc344 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:17.620019 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-38c28689-377d-4673-8aaa-08c3b09fc344 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1504 microversion: 2.1 time: 0.154851 Oct 28 08:42:17.620602 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 208/471] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:17 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:18.130990 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a35d2976-675c-4e39-9524-872047056260 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:18.132014 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a35d2976-675c-4e39-9524-872047056260 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:18.139254 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a35d2976-675c-4e39-9524-872047056260 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.139699 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a35d2976-675c-4e39-9524-872047056260 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.140483 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a35d2976-675c-4e39-9524-872047056260 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.140916 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a35d2976-675c-4e39-9524-872047056260 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.277464 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a35d2976-675c-4e39-9524-872047056260 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 14 microversion: 2.20 time: 0.150323 Oct 28 08:42:18.278150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 264/472] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:18 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:18.296396 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-aeeb625e-0f90-4348-a228-e804003976d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:18.296981 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-aeeb625e-0f90-4348-a228-e804003976d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:18.303513 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aeeb625e-0f90-4348-a228-e804003976d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.303951 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aeeb625e-0f90-4348-a228-e804003976d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.304712 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aeeb625e-0f90-4348-a228-e804003976d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.305149 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aeeb625e-0f90-4348-a228-e804003976d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.333085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4b429686-47db-4901-a080-d1c59e15ff2f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:18.334200 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4b429686-47db-4901-a080-d1c59e15ff2f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:18.349904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4b429686-47db-4901-a080-d1c59e15ff2f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.350119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4b429686-47db-4901-a080-d1c59e15ff2f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.350808 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4b429686-47db-4901-a080-d1c59e15ff2f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.351243 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4b429686-47db-4901-a080-d1c59e15ff2f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.437296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aeeb625e-0f90-4348-a228-e804003976d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:18.443790 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4b429686-47db-4901-a080-d1c59e15ff2f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.115030 Oct 28 08:42:18.447789 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 265/473] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:18 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:18.450814 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-aeeb625e-0f90-4348-a228-e804003976d3 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1514 microversion: 2.1 time: 0.158054 Oct 28 08:42:18.451418 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 209/474] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:18 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:18.480987 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9c19bb68-b993-452e-a1f6-952311bb253e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:18.481940 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9c19bb68-b993-452e-a1f6-952311bb253e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:18.491955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9c19bb68-b993-452e-a1f6-952311bb253e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.492394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9c19bb68-b993-452e-a1f6-952311bb253e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.493185 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9c19bb68-b993-452e-a1f6-952311bb253e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.493590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9c19bb68-b993-452e-a1f6-952311bb253e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.535321 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a914c1b5-54dc-4d0b-a9b0-df2a2d09be72 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:18.536343 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a914c1b5-54dc-4d0b-a9b0-df2a2d09be72 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:18.542415 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a914c1b5-54dc-4d0b-a9b0-df2a2d09be72 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.543070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a914c1b5-54dc-4d0b-a9b0-df2a2d09be72 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.544152 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a914c1b5-54dc-4d0b-a9b0-df2a2d09be72 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.544736 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a914c1b5-54dc-4d0b-a9b0-df2a2d09be72 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.712823 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9c19bb68-b993-452e-a1f6-952311bb253e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:18.721034 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9c19bb68-b993-452e-a1f6-952311bb253e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.243923 Oct 28 08:42:18.721642 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 266/475] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:18 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:18.727174 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4ca8d242-6138-491c-8821-c45ecf5deba1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:18.728040 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4ca8d242-6138-491c-8821-c45ecf5deba1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:18.734099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ca8d242-6138-491c-8821-c45ecf5deba1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.734593 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ca8d242-6138-491c-8821-c45ecf5deba1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.735441 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ca8d242-6138-491c-8821-c45ecf5deba1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:18.736226 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ca8d242-6138-491c-8821-c45ecf5deba1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:18.759466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a914c1b5-54dc-4d0b-a9b0-df2a2d09be72 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:18.768314 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a914c1b5-54dc-4d0b-a9b0-df2a2d09be72 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.236544 Oct 28 08:42:18.769495 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 210/476] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:18 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:18.882470 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-4ca8d242-6138-491c-8821-c45ecf5deba1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:18.889846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4ca8d242-6138-491c-8821-c45ecf5deba1 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1504 microversion: 2.1 time: 0.166883 Oct 28 08:42:18.890551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 267/477] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:18 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:19.290082 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2f22911f-bafb-4955-9a4d-121726de537f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:19.291074 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2f22911f-bafb-4955-9a4d-121726de537f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:19.297024 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f22911f-bafb-4955-9a4d-121726de537f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:19.297598 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f22911f-bafb-4955-9a4d-121726de537f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:19.298239 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f22911f-bafb-4955-9a4d-121726de537f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:19.298672 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f22911f-bafb-4955-9a4d-121726de537f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:19.455562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2a05a915-1d4e-4f0e-bef3-bc0ff66d7e38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:19.456525 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2a05a915-1d4e-4f0e-bef3-bc0ff66d7e38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:19.462867 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2a05a915-1d4e-4f0e-bef3-bc0ff66d7e38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:19.463307 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2a05a915-1d4e-4f0e-bef3-bc0ff66d7e38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:19.464062 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2a05a915-1d4e-4f0e-bef3-bc0ff66d7e38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:19.464488 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2a05a915-1d4e-4f0e-bef3-bc0ff66d7e38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.794127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2a05a915-1d4e-4f0e-bef3-bc0ff66d7e38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 4.341541 Oct 28 08:42:23.795786 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 268/478] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:19 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 4344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:23.805346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-31e924ee-a3e5-4459-95bd-8ccaeff1692a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:23.806656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-31e924ee-a3e5-4459-95bd-8ccaeff1692a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:23.820807 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31e924ee-a3e5-4459-95bd-8ccaeff1692a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.821690 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31e924ee-a3e5-4459-95bd-8ccaeff1692a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.823077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31e924ee-a3e5-4459-95bd-8ccaeff1692a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.823869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-31e924ee-a3e5-4459-95bd-8ccaeff1692a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.830127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2f22911f-bafb-4955-9a4d-121726de537f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 21674 microversion: 2.20 time: 4.544608 Oct 28 08:42:23.831903 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 211/479] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:19 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 21674 bytes in 4547 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:23.840865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f89d0a08-a243-4881-a8d9-604d639c84b0 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:23.844363 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f89d0a08-a243-4881-a8d9-604d639c84b0 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:23.858024 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f89d0a08-a243-4881-a8d9-604d639c84b0 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.861224 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f89d0a08-a243-4881-a8d9-604d639c84b0 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.862053 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f89d0a08-a243-4881-a8d9-604d639c84b0 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.862457 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f89d0a08-a243-4881-a8d9-604d639c84b0 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:24.113168 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-31e924ee-a3e5-4459-95bd-8ccaeff1692a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:24.121257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-31e924ee-a3e5-4459-95bd-8ccaeff1692a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.323736 Oct 28 08:42:24.121939 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 269/480] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:23 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:24.126579 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-037b5fd7-870e-4e16-9a84-d2f508b2f968 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:24.127296 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-037b5fd7-870e-4e16-9a84-d2f508b2f968 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:24.134429 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-037b5fd7-870e-4e16-9a84-d2f508b2f968 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:24.134966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-037b5fd7-870e-4e16-9a84-d2f508b2f968 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:24.135821 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-037b5fd7-870e-4e16-9a84-d2f508b2f968 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:24.136322 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-037b5fd7-870e-4e16-9a84-d2f508b2f968 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:24.188808 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f89d0a08-a243-4881-a8d9-604d639c84b0 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:24.197415 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f89d0a08-a243-4881-a8d9-604d639c84b0 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.362984 Oct 28 08:42:24.198007 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 212/481] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:23 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:24.202587 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-a1da4f0f-8dfc-4949-94c0-b0c09e30d45f req-8188bd3d-a5f0-4fe2-bcf9-8ddea81fc092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb953696-803c-4e65-817a-a00f31b18289", "name": "network-vif-plugged", "status": "completed", "tag": "552b122b-0a21-4e0d-8069-7363bb657c19"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:24.204085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:24.204085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:42:24.210914 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-a1da4f0f-8dfc-4949-94c0-b0c09e30d45f req-8188bd3d-a5f0-4fe2-bcf9-8ddea81fc092 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:24.211354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-a1da4f0f-8dfc-4949-94c0-b0c09e30d45f req-8188bd3d-a5f0-4fe2-bcf9-8ddea81fc092 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:24.222211 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-a1da4f0f-8dfc-4949-94c0-b0c09e30d45f req-8188bd3d-a5f0-4fe2-bcf9-8ddea81fc092 service nova] Creating event network-vif-plugged:552b122b-0a21-4e0d-8069-7363bb657c19 for instance fb953696-803c-4e65-817a-a00f31b18289 on hv-cinder-81566 Oct 28 08:42:24.226962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-a1da4f0f-8dfc-4949-94c0-b0c09e30d45f req-8188bd3d-a5f0-4fe2-bcf9-8ddea81fc092 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027829 Oct 28 08:42:24.228566 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 213/482] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:24.358438 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-037b5fd7-870e-4e16-9a84-d2f508b2f968 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:24.368106 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-037b5fd7-870e-4e16-9a84-d2f508b2f968 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1504 microversion: 2.1 time: 0.245077 Oct 28 08:42:24.368695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 270/483] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:24 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:24.542133 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-ce0f4a5e-af19-49ea-9564-4055f51c3dae req-843f4e27-ebf5-4d4f-9eb3-680388f16c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95903824-5909-4930-9086-b397f444209f", "name": "network-vif-deleted", "tag": "bfff1222-7dd2-4253-8d4c-d377f04b2acf"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:24.549949 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:24.549949 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:42:24.551092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-ce0f4a5e-af19-49ea-9564-4055f51c3dae req-843f4e27-ebf5-4d4f-9eb3-680388f16c76 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:24.552786 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-ce0f4a5e-af19-49ea-9564-4055f51c3dae req-843f4e27-ebf5-4d4f-9eb3-680388f16c76 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:24.565211 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-ce0f4a5e-af19-49ea-9564-4055f51c3dae req-843f4e27-ebf5-4d4f-9eb3-680388f16c76 service nova] Creating event network-vif-deleted:bfff1222-7dd2-4253-8d4c-d377f04b2acf for instance 95903824-5909-4930-9086-b397f444209f on hv-cinder-81566 Oct 28 08:42:24.570646 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-ce0f4a5e-af19-49ea-9564-4055f51c3dae req-843f4e27-ebf5-4d4f-9eb3-680388f16c76 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033213 Oct 28 08:42:24.571220 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 214/484] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:24.808890 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-99be4103-450c-47b4-b53e-0f9401bf4752 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:24.809879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-99be4103-450c-47b4-b53e-0f9401bf4752 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:24.816133 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99be4103-450c-47b4-b53e-0f9401bf4752 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:24.816692 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99be4103-450c-47b4-b53e-0f9401bf4752 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:24.818196 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99be4103-450c-47b4-b53e-0f9401bf4752 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:24.818629 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99be4103-450c-47b4-b53e-0f9401bf4752 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:24.845498 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-de2104dd-30d7-4140-a3d7-eb4de7fb8d86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:24.846525 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-de2104dd-30d7-4140-a3d7-eb4de7fb8d86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:24.854100 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de2104dd-30d7-4140-a3d7-eb4de7fb8d86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:24.854574 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de2104dd-30d7-4140-a3d7-eb4de7fb8d86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:24.855493 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de2104dd-30d7-4140-a3d7-eb4de7fb8d86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:24.855941 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de2104dd-30d7-4140-a3d7-eb4de7fb8d86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:24.937470 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-99be4103-450c-47b4-b53e-0f9401bf4752 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.132139 Oct 28 08:42:24.938844 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 271/485] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:24 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:24.975829 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-de2104dd-30d7-4140-a3d7-eb4de7fb8d86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 23185 microversion: 2.20 time: 0.134298 Oct 28 08:42:24.976710 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 215/486] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:24 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 23185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:25.139331 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e96a7160-d511-403a-92f8-7ff98b7d8231 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:25.140023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e96a7160-d511-403a-92f8-7ff98b7d8231 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:25.147392 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e96a7160-d511-403a-92f8-7ff98b7d8231 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.147837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e96a7160-d511-403a-92f8-7ff98b7d8231 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.148597 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e96a7160-d511-403a-92f8-7ff98b7d8231 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.149028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e96a7160-d511-403a-92f8-7ff98b7d8231 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.214908 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f2fdbebc-f808-42e8-9f21-d671192830e1 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:25.215487 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f2fdbebc-f808-42e8-9f21-d671192830e1 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:25.222683 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2fdbebc-f808-42e8-9f21-d671192830e1 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.223131 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2fdbebc-f808-42e8-9f21-d671192830e1 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.224477 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2fdbebc-f808-42e8-9f21-d671192830e1 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.225218 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2fdbebc-f808-42e8-9f21-d671192830e1 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.311038 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e96a7160-d511-403a-92f8-7ff98b7d8231 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:25.319157 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e96a7160-d511-403a-92f8-7ff98b7d8231 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.183841 Oct 28 08:42:25.319929 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 272/487] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:25 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:25.375157 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f2fdbebc-f808-42e8-9f21-d671192830e1 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:25.384544 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f2fdbebc-f808-42e8-9f21-d671192830e1 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1314 microversion: 2.1 time: 0.173732 Oct 28 08:42:25.385393 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 216/488] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:25 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:25.385889 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:25.387157 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:25.393014 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.393459 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.394254 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.394680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.428673 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.429314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.429989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lazy-loading 'fault' on Instance uuid 95903824-5909-4930-9086-b397f444209f {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:42:25.476763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9c2df8ea2c42c3a7e1d313834fc4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5524f9a286464e8db7e4cb81c3879647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:25.485225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-19507da1-c8d9-4710-9d5b-2f439040b082 tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 200 len: 1304 microversion: 2.1 time: 0.102914 Oct 28 08:42:25.485915 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 273/489] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:25 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:25.950400 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-64c5b231-5b70-4524-b202-f790bafc4e14 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:25.951313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-64c5b231-5b70-4524-b202-f790bafc4e14 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:25.958511 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64c5b231-5b70-4524-b202-f790bafc4e14 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.958951 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64c5b231-5b70-4524-b202-f790bafc4e14 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.959717 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64c5b231-5b70-4524-b202-f790bafc4e14 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.960152 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64c5b231-5b70-4524-b202-f790bafc4e14 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.986564 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4ae65a83-4165-4005-a347-9a299f402caf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:25.987508 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4ae65a83-4165-4005-a347-9a299f402caf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:25.994421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ae65a83-4165-4005-a347-9a299f402caf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.994944 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ae65a83-4165-4005-a347-9a299f402caf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.995828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ae65a83-4165-4005-a347-9a299f402caf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.996328 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ae65a83-4165-4005-a347-9a299f402caf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.034886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-64c5b231-5b70-4524-b202-f790bafc4e14 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.088112 Oct 28 08:42:26.035609 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 217/490] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:25 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:26.100281 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4ae65a83-4165-4005-a347-9a299f402caf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 23803 microversion: 2.20 time: 0.117282 Oct 28 08:42:26.101138 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 274/491] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:25 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 23803 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:26.179512 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3c83574e-5e9d-47c2-a38b-2410cbb8fe90 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:26.180202 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3c83574e-5e9d-47c2-a38b-2410cbb8fe90 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:26.187013 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c83574e-5e9d-47c2-a38b-2410cbb8fe90 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.187517 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c83574e-5e9d-47c2-a38b-2410cbb8fe90 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.188277 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c83574e-5e9d-47c2-a38b-2410cbb8fe90 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.188706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c83574e-5e9d-47c2-a38b-2410cbb8fe90 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.243464 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-d21b1c29-bfcf-424a-a797-0e063b53eacf req-57dd039a-eda3-4652-9ec8-509f17f86fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95903824-5909-4930-9086-b397f444209f", "name": "network-vif-unplugged", "status": "completed", "tag": "bfff1222-7dd2-4253-8d4c-d377f04b2acf"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:26.244976 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:26.244976 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:42:26.253742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-d21b1c29-bfcf-424a-a797-0e063b53eacf req-57dd039a-eda3-4652-9ec8-509f17f86fe2 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.254206 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-d21b1c29-bfcf-424a-a797-0e063b53eacf req-57dd039a-eda3-4652-9ec8-509f17f86fe2 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.266544 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-d21b1c29-bfcf-424a-a797-0e063b53eacf req-57dd039a-eda3-4652-9ec8-509f17f86fe2 service nova] Creating event network-vif-unplugged:bfff1222-7dd2-4253-8d4c-d377f04b2acf for instance 95903824-5909-4930-9086-b397f444209f on hv-cinder-81566 Oct 28 08:42:26.273092 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-d21b1c29-bfcf-424a-a797-0e063b53eacf req-57dd039a-eda3-4652-9ec8-509f17f86fe2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034000 Oct 28 08:42:26.273707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 275/492] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:26.325952 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3c83574e-5e9d-47c2-a38b-2410cbb8fe90 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:26.335048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3c83574e-5e9d-47c2-a38b-2410cbb8fe90 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1514 microversion: 2.1 time: 0.159001 Oct 28 08:42:26.335048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 218/493] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:26 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:26.337603 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-37cbf927-725b-4e1c-89e4-03c9a81f6ce6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:26.338333 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-37cbf927-725b-4e1c-89e4-03c9a81f6ce6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:26.344614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-37cbf927-725b-4e1c-89e4-03c9a81f6ce6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.345304 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-37cbf927-725b-4e1c-89e4-03c9a81f6ce6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.345926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-37cbf927-725b-4e1c-89e4-03c9a81f6ce6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.346369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-37cbf927-725b-4e1c-89e4-03c9a81f6ce6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.351778 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f7258c73-e49f-4474-a16c-e5fe4936a936 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1db700b7-6512-4a99-8ddb-a5eb8f5ad989"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:26.351991 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f7258c73-e49f-4474-a16c-e5fe4936a936 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:26.357750 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7258c73-e49f-4474-a16c-e5fe4936a936 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.358231 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7258c73-e49f-4474-a16c-e5fe4936a936 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.359063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7258c73-e49f-4474-a16c-e5fe4936a936 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.359503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7258c73-e49f-4474-a16c-e5fe4936a936 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.512328 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-37cbf927-725b-4e1c-89e4-03c9a81f6ce6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:26.525098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-37cbf927-725b-4e1c-89e4-03c9a81f6ce6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.192233 Oct 28 08:42:26.526955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 276/494] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:26 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:26.533973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-58497396-d1b8-416f-b6c9-9ba3e424f0fd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:26.534585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-58497396-d1b8-416f-b6c9-9ba3e424f0fd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:26.542941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-58497396-d1b8-416f-b6c9-9ba3e424f0fd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.543398 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-58497396-d1b8-416f-b6c9-9ba3e424f0fd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.544189 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-58497396-d1b8-416f-b6c9-9ba3e424f0fd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.544627 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-58497396-d1b8-416f-b6c9-9ba3e424f0fd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.682204 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f7258c73-e49f-4474-a16c-e5fe4936a936 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334822 Oct 28 08:42:26.683884 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 219/495] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:42:26 2021] POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:26.691349 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-64e883b6-9012-43e0-a930-44d8a1a9524d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:26.693725 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-64e883b6-9012-43e0-a930-44d8a1a9524d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] [instance: 95903824-5909-4930-9086-b397f444209f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:26.698300 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-58497396-d1b8-416f-b6c9-9ba3e424f0fd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:26.700456 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64e883b6-9012-43e0-a930-44d8a1a9524d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.701132 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64e883b6-9012-43e0-a930-44d8a1a9524d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.701925 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64e883b6-9012-43e0-a930-44d8a1a9524d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.702529 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-64e883b6-9012-43e0-a930-44d8a1a9524d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.715010 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-58497396-d1b8-416f-b6c9-9ba3e424f0fd tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1463 microversion: 2.1 time: 0.186193 Oct 28 08:42:26.716588 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 277/496] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:26 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1463 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:26.720345 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-64e883b6-9012-43e0-a930-44d8a1a9524d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] HTTP exception thrown: Instance 95903824-5909-4930-9086-b397f444209f could not be found. Oct 28 08:42:26.721271 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-64e883b6-9012-43e0-a930-44d8a1a9524d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] Returning 404 to user: Instance 95903824-5909-4930-9086-b397f444209f could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:42:26.722532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-64e883b6-9012-43e0-a930-44d8a1a9524d tempest-VolumesActionsTest-1202727258 tempest-VolumesActionsTest-1202727258-project] 10.222.0.74 "GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f" status: 404 len: 111 microversion: 2.1 time: 0.037166 Oct 28 08:42:26.723849 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 220/497] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:26 2021] GET /compute/v2.1/servers/95903824-5909-4930-9086-b397f444209f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:42:26.762535 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-10743dc1-6790-4a2e-b01a-95976c541cfc tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:26.763030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-10743dc1-6790-4a2e-b01a-95976c541cfc tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:26.768984 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10743dc1-6790-4a2e-b01a-95976c541cfc tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.769210 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10743dc1-6790-4a2e-b01a-95976c541cfc tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.770038 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10743dc1-6790-4a2e-b01a-95976c541cfc tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.770496 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10743dc1-6790-4a2e-b01a-95976c541cfc tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.801067 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-10743dc1-6790-4a2e-b01a-95976c541cfc tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Going to try to terminate instance {{(pid=132797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:42:26.892257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-10743dc1-6790-4a2e-b01a-95976c541cfc tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "DELETE /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 204 len: 0 microversion: 2.1 time: 0.129678 Oct 28 08:42:26.893758 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 278/498] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:42:26 2021] DELETE /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:42:26.906189 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0b786795-05e2-481e-b066-f65711a7e7a2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:26.907147 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0b786795-05e2-481e-b066-f65711a7e7a2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:26.917064 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b786795-05e2-481e-b066-f65711a7e7a2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.917818 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b786795-05e2-481e-b066-f65711a7e7a2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.919105 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b786795-05e2-481e-b066-f65711a7e7a2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.919827 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b786795-05e2-481e-b066-f65711a7e7a2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.048850 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-eef24572-5ae3-4c9c-8cdb-ccea775e1b71 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:27.049962 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-eef24572-5ae3-4c9c-8cdb-ccea775e1b71 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:27.056530 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eef24572-5ae3-4c9c-8cdb-ccea775e1b71 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.057866 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eef24572-5ae3-4c9c-8cdb-ccea775e1b71 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.058966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eef24572-5ae3-4c9c-8cdb-ccea775e1b71 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.059607 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eef24572-5ae3-4c9c-8cdb-ccea775e1b71 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.059860 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0b786795-05e2-481e-b066-f65711a7e7a2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:27.067914 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0b786795-05e2-481e-b066-f65711a7e7a2 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1469 microversion: 2.1 time: 0.166971 Oct 28 08:42:27.068959 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 221/499] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:26 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:27.111433 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-168bc738-7828-4d31-a0b9-c3bb14369576 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:27.112432 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-168bc738-7828-4d31-a0b9-c3bb14369576 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:27.119397 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-168bc738-7828-4d31-a0b9-c3bb14369576 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.121963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-168bc738-7828-4d31-a0b9-c3bb14369576 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.121963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-168bc738-7828-4d31-a0b9-c3bb14369576 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.121963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-168bc738-7828-4d31-a0b9-c3bb14369576 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.144383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-eef24572-5ae3-4c9c-8cdb-ccea775e1b71 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.099362 Oct 28 08:42:27.146703 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 279/500] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:27 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:27.235465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-168bc738-7828-4d31-a0b9-c3bb14369576 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 24422 microversion: 2.20 time: 0.127509 Oct 28 08:42:27.236279 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 222/501] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:27 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 24422 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:27.543425 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-06e04cf3-f3f9-420b-97e8-56eadc87855c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:27.544153 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-06e04cf3-f3f9-420b-97e8-56eadc87855c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:27.551037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-06e04cf3-f3f9-420b-97e8-56eadc87855c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.552912 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-06e04cf3-f3f9-420b-97e8-56eadc87855c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.553699 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-06e04cf3-f3f9-420b-97e8-56eadc87855c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.554173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-06e04cf3-f3f9-420b-97e8-56eadc87855c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.701887 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-06e04cf3-f3f9-420b-97e8-56eadc87855c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:27.709133 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-06e04cf3-f3f9-420b-97e8-56eadc87855c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.169786 Oct 28 08:42:27.709706 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 280/502] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:27 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:28.085751 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0d7eba9f-450a-4cbf-b065-e84ca787934c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:28.086475 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0d7eba9f-450a-4cbf-b065-e84ca787934c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:28.093855 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d7eba9f-450a-4cbf-b065-e84ca787934c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.094301 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d7eba9f-450a-4cbf-b065-e84ca787934c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.095078 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d7eba9f-450a-4cbf-b065-e84ca787934c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.095507 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d7eba9f-450a-4cbf-b065-e84ca787934c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.156923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-725cb727-f9f2-40e2-bc61-42ef14b6842c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:28.157908 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-725cb727-f9f2-40e2-bc61-42ef14b6842c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:28.164867 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-725cb727-f9f2-40e2-bc61-42ef14b6842c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.165321 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-725cb727-f9f2-40e2-bc61-42ef14b6842c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.166132 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-725cb727-f9f2-40e2-bc61-42ef14b6842c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.166563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-725cb727-f9f2-40e2-bc61-42ef14b6842c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.230099 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0d7eba9f-450a-4cbf-b065-e84ca787934c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:28.237708 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0d7eba9f-450a-4cbf-b065-e84ca787934c tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1469 microversion: 2.1 time: 0.156419 Oct 28 08:42:28.238315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 223/503] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:28 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:28.247332 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-21effa60-9d1b-4540-b688-123c0682a7ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:28.248239 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-21effa60-9d1b-4540-b688-123c0682a7ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:28.254181 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21effa60-9d1b-4540-b688-123c0682a7ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.255345 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21effa60-9d1b-4540-b688-123c0682a7ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.256188 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21effa60-9d1b-4540-b688-123c0682a7ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.256615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21effa60-9d1b-4540-b688-123c0682a7ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.510755 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-21effa60-9d1b-4540-b688-123c0682a7ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 25087 microversion: 2.20 time: 0.266834 Oct 28 08:42:28.514642 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 224/504] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:28 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 25087 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:28.516362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-b8fd2da8-b21f-4e11-8ac9-1e627217c31a req-b17057fc-8b4e-4b1c-966a-2459ea62e606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50b0126-b6b3-4fbf-8596-0f7b3d5877f6", "name": "network-vif-plugged", "status": "completed", "tag": "760c9603-2fe5-4dc3-aa4c-7ff255fee93d"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:28.517853 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:28.517853 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:42:28.525944 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-b8fd2da8-b21f-4e11-8ac9-1e627217c31a req-b17057fc-8b4e-4b1c-966a-2459ea62e606 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.526387 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-b8fd2da8-b21f-4e11-8ac9-1e627217c31a req-b17057fc-8b4e-4b1c-966a-2459ea62e606 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.529285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-725cb727-f9f2-40e2-bc61-42ef14b6842c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.375724 Oct 28 08:42:28.530217 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 281/505] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:28 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:28.535016 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0db28860-e293-46ba-85cd-3547f8014660 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:28.535591 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0db28860-e293-46ba-85cd-3547f8014660 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:28.539311 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-b8fd2da8-b21f-4e11-8ac9-1e627217c31a req-b17057fc-8b4e-4b1c-966a-2459ea62e606 service nova] Creating event network-vif-plugged:760c9603-2fe5-4dc3-aa4c-7ff255fee93d for instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 on hv-cinder-81566 Oct 28 08:42:28.543183 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0db28860-e293-46ba-85cd-3547f8014660 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.543681 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0db28860-e293-46ba-85cd-3547f8014660 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.544059 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-b8fd2da8-b21f-4e11-8ac9-1e627217c31a req-b17057fc-8b4e-4b1c-966a-2459ea62e606 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031296 Oct 28 08:42:28.544454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0db28860-e293-46ba-85cd-3547f8014660 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.544640 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 225/506] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:28.544885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0db28860-e293-46ba-85cd-3547f8014660 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.697834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-0db28860-e293-46ba-85cd-3547f8014660 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lazy-loading 'services' on Instance uuid 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:42:28.726272 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-95aa5081-8adf-4385-9380-87d31eada9bb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:28.726965 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-95aa5081-8adf-4385-9380-87d31eada9bb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:28.733225 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-95aa5081-8adf-4385-9380-87d31eada9bb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.733680 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-95aa5081-8adf-4385-9380-87d31eada9bb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.734482 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-95aa5081-8adf-4385-9380-87d31eada9bb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.734914 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-95aa5081-8adf-4385-9380-87d31eada9bb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.815925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0db28860-e293-46ba-85cd-3547f8014660 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "DELETE /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587/os-volume_attachments/9b6f2d91-3261-4d3a-9270-bcfe480c1c85" status: 202 len: 0 microversion: 2.1 time: 0.284424 Oct 28 08:42:28.816989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 282/507] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:42:28 2021] DELETE /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587/os-volume_attachments/9b6f2d91-3261-4d3a-9270-bcfe480c1c85 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:28.894428 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-95aa5081-8adf-4385-9380-87d31eada9bb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:28.902231 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-95aa5081-8adf-4385-9380-87d31eada9bb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.180632 Oct 28 08:42:28.902799 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 226/508] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:28 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:29.256154 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-da37d9e4-7408-4b84-adc9-96a05fb4a863 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:29.256841 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-da37d9e4-7408-4b84-adc9-96a05fb4a863 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:29.264062 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-da37d9e4-7408-4b84-adc9-96a05fb4a863 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:29.264504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-da37d9e4-7408-4b84-adc9-96a05fb4a863 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:29.265281 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-da37d9e4-7408-4b84-adc9-96a05fb4a863 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:29.265721 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-da37d9e4-7408-4b84-adc9-96a05fb4a863 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:29.401752 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-da37d9e4-7408-4b84-adc9-96a05fb4a863 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:29.409524 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-da37d9e4-7408-4b84-adc9-96a05fb4a863 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1469 microversion: 2.1 time: 0.157884 Oct 28 08:42:29.410140 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 283/509] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:29 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:29.522724 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e411c380-af4e-4339-8a7a-d335b0729639 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:29.523581 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e411c380-af4e-4339-8a7a-d335b0729639 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:29.529846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e411c380-af4e-4339-8a7a-d335b0729639 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:29.530294 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e411c380-af4e-4339-8a7a-d335b0729639 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:29.531047 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e411c380-af4e-4339-8a7a-d335b0729639 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:29.531476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e411c380-af4e-4339-8a7a-d335b0729639 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:29.540455 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-48bc4fdb-fdb1-4be3-9864-28d0ff4b1836 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:29.541426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-48bc4fdb-fdb1-4be3-9864-28d0ff4b1836 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:29.547454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48bc4fdb-fdb1-4be3-9864-28d0ff4b1836 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:29.547897 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48bc4fdb-fdb1-4be3-9864-28d0ff4b1836 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:29.548668 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48bc4fdb-fdb1-4be3-9864-28d0ff4b1836 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:29.549175 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48bc4fdb-fdb1-4be3-9864-28d0ff4b1836 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:32.585557 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e411c380-af4e-4339-8a7a-d335b0729639 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 27691 microversion: 2.20 time: 3.066745 Oct 28 08:42:32.586600 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 227/510] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:29 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 27691 bytes in 3069 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:32.591392 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-87b2d9d0-a219-462c-8de5-a25a551ff30f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:32.592084 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-87b2d9d0-a219-462c-8de5-a25a551ff30f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:32.599601 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-87b2d9d0-a219-462c-8de5-a25a551ff30f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:32.600092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-87b2d9d0-a219-462c-8de5-a25a551ff30f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:32.600868 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-87b2d9d0-a219-462c-8de5-a25a551ff30f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:32.601300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-87b2d9d0-a219-462c-8de5-a25a551ff30f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:32.601461 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-48bc4fdb-fdb1-4be3-9864-28d0ff4b1836 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 3.064468 Oct 28 08:42:32.602184 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 284/511] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:29 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 3066 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:32.607126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-051231f5-b0cf-4da5-9ada-90e8af4b8417 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:32.607730 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-051231f5-b0cf-4da5-9ada-90e8af4b8417 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:32.623496 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-051231f5-b0cf-4da5-9ada-90e8af4b8417 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:32.624210 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-051231f5-b0cf-4da5-9ada-90e8af4b8417 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:32.627116 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-051231f5-b0cf-4da5-9ada-90e8af4b8417 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:32.627116 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-051231f5-b0cf-4da5-9ada-90e8af4b8417 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.050878 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-87b2d9d0-a219-462c-8de5-a25a551ff30f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:33.055685 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-051231f5-b0cf-4da5-9ada-90e8af4b8417 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:33.065624 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-87b2d9d0-a219-462c-8de5-a25a551ff30f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.477860 Oct 28 08:42:33.066425 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 228/512] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:32 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:33.071519 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-051231f5-b0cf-4da5-9ada-90e8af4b8417 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1469 microversion: 2.1 time: 0.467970 Oct 28 08:42:33.072191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 285/513] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:32 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1469 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:33.597497 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a13025e5-d9ba-46da-9691-af033be9a7d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:33.598536 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a13025e5-d9ba-46da-9691-af033be9a7d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:33.605593 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a13025e5-d9ba-46da-9691-af033be9a7d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:33.606063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a13025e5-d9ba-46da-9691-af033be9a7d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.606826 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a13025e5-d9ba-46da-9691-af033be9a7d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:33.607315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a13025e5-d9ba-46da-9691-af033be9a7d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.614961 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a6752e40-869d-44e9-b493-7e71ef5cb0a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:33.616191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a6752e40-869d-44e9-b493-7e71ef5cb0a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:33.623354 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6752e40-869d-44e9-b493-7e71ef5cb0a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:33.623949 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6752e40-869d-44e9-b493-7e71ef5cb0a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.624793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6752e40-869d-44e9-b493-7e71ef5cb0a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:33.625289 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6752e40-869d-44e9-b493-7e71ef5cb0a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.982185 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a6752e40-869d-44e9-b493-7e71ef5cb0a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.371549 Oct 28 08:42:33.983189 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 286/514] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:33 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:34.005460 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a13025e5-d9ba-46da-9691-af033be9a7d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 27805 microversion: 2.20 time: 0.411074 Oct 28 08:42:34.006454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 229/515] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:33 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 27805 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:34.084168 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-04a8c157-ce72-4b0b-a441-9c6c76a5c2b8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:34.084869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-04a8c157-ce72-4b0b-a441-9c6c76a5c2b8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:34.089910 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f5c3ef5e-41ac-43e2-a7ea-a6265fdfa7ee tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:34.090625 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f5c3ef5e-41ac-43e2-a7ea-a6265fdfa7ee tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:34.092609 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04a8c157-ce72-4b0b-a441-9c6c76a5c2b8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.093083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04a8c157-ce72-4b0b-a441-9c6c76a5c2b8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.093893 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04a8c157-ce72-4b0b-a441-9c6c76a5c2b8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.094326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04a8c157-ce72-4b0b-a441-9c6c76a5c2b8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.099226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5c3ef5e-41ac-43e2-a7ea-a6265fdfa7ee tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.099721 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5c3ef5e-41ac-43e2-a7ea-a6265fdfa7ee tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.100515 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5c3ef5e-41ac-43e2-a7ea-a6265fdfa7ee tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.100948 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5c3ef5e-41ac-43e2-a7ea-a6265fdfa7ee tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.409134 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f5c3ef5e-41ac-43e2-a7ea-a6265fdfa7ee tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:34.423211 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f5c3ef5e-41ac-43e2-a7ea-a6265fdfa7ee tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1469 microversion: 2.1 time: 0.337878 Oct 28 08:42:34.434302 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 230/516] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:34 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1469 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:34.517558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-04a8c157-ce72-4b0b-a441-9c6c76a5c2b8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:34.527046 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-04a8c157-ce72-4b0b-a441-9c6c76a5c2b8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1359 microversion: 2.1 time: 0.447275 Oct 28 08:42:34.539329 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 287/517] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:34 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1359 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:34.890124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-eb8dbbc4-0782-41a7-bb14-67573d0407e2 req-1958e76e-1148-487c-93d2-4c39df1db4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb953696-803c-4e65-817a-a00f31b18289", "name": "network-vif-deleted", "tag": "552b122b-0a21-4e0d-8069-7363bb657c19"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:34.892749 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:34.892749 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:42:34.903563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-eb8dbbc4-0782-41a7-bb14-67573d0407e2 req-1958e76e-1148-487c-93d2-4c39df1db4a4 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.905251 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-eb8dbbc4-0782-41a7-bb14-67573d0407e2 req-1958e76e-1148-487c-93d2-4c39df1db4a4 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.920714 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-eb8dbbc4-0782-41a7-bb14-67573d0407e2 req-1958e76e-1148-487c-93d2-4c39df1db4a4 service nova] Creating event network-vif-deleted:552b122b-0a21-4e0d-8069-7363bb657c19 for instance fb953696-803c-4e65-817a-a00f31b18289 on hv-cinder-81566 Oct 28 08:42:34.927701 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-eb8dbbc4-0782-41a7-bb14-67573d0407e2 req-1958e76e-1148-487c-93d2-4c39df1db4a4 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040415 Oct 28 08:42:34.932490 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 231/518] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:34.993962 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-99331f23-c368-4a8f-8213-3eefc79a6a09 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:34.995712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-99331f23-c368-4a8f-8213-3eefc79a6a09 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:35.002242 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99331f23-c368-4a8f-8213-3eefc79a6a09 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.003005 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99331f23-c368-4a8f-8213-3eefc79a6a09 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.004016 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99331f23-c368-4a8f-8213-3eefc79a6a09 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.004905 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99331f23-c368-4a8f-8213-3eefc79a6a09 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.025743 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a6e52d89-2216-4a93-a95d-5437076bdaec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:35.026793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a6e52d89-2216-4a93-a95d-5437076bdaec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:35.038525 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6e52d89-2216-4a93-a95d-5437076bdaec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.042034 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6e52d89-2216-4a93-a95d-5437076bdaec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.042889 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6e52d89-2216-4a93-a95d-5437076bdaec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.043341 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6e52d89-2216-4a93-a95d-5437076bdaec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.285325 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-99331f23-c368-4a8f-8213-3eefc79a6a09 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.295249 Oct 28 08:42:35.288258 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 288/519] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:34 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:35.340348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a6e52d89-2216-4a93-a95d-5437076bdaec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 27932 microversion: 2.20 time: 0.319351 Oct 28 08:42:35.341122 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 232/520] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:35 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 27932 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:35.346343 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3ad32b34-8d99-4ddd-acd0-aecdb4ba8b0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:35.347941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3ad32b34-8d99-4ddd-acd0-aecdb4ba8b0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:35.371098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3ad32b34-8d99-4ddd-acd0-aecdb4ba8b0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.372199 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3ad32b34-8d99-4ddd-acd0-aecdb4ba8b0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.375095 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3ad32b34-8d99-4ddd-acd0-aecdb4ba8b0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.376209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3ad32b34-8d99-4ddd-acd0-aecdb4ba8b0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.442161 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:35.445611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:35.452965 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.454926 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.456185 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.456932 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.466789 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-3ad32b34-8d99-4ddd-acd0-aecdb4ba8b0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lazy-loading 'flavor' on Instance uuid c70c146b-a5ed-43af-aad8-18fb35f2dab5 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:42:35.547410 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.547864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.548325 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.objects.instance [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lazy-loading 'fault' on Instance uuid fb953696-803c-4e65-817a-a00f31b18289 {{(pid=132796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:42:35.620313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d26344ce664777869b68c84566d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17c94064e3e4771a88f32c016d0f62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:35.631154 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-52dccf13-60cc-4a29-895e-24ba777701ca tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 200 len: 1304 microversion: 2.1 time: 0.193362 Oct 28 08:42:35.632071 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 233/521] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:35 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 1304 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:35.637046 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-be07eef8-899e-4169-bb5c-f3f0545c81c9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:35.637629 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-be07eef8-899e-4169-bb5c-f3f0545c81c9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:35.646183 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-be07eef8-899e-4169-bb5c-f3f0545c81c9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.647183 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-be07eef8-899e-4169-bb5c-f3f0545c81c9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.648183 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-be07eef8-899e-4169-bb5c-f3f0545c81c9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.648759 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-be07eef8-899e-4169-bb5c-f3f0545c81c9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.742844 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3ad32b34-8d99-4ddd-acd0-aecdb4ba8b0c tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/action" status: 200 len: 32 microversion: 2.1 time: 0.407999 Oct 28 08:42:35.743907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 289/522] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:35 2021] POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/action => generated 32 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:42:35.769906 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-39a4320b-35b1-4836-9f8f-e9d56435d4fd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:35.775634 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-39a4320b-35b1-4836-9f8f-e9d56435d4fd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:35.788608 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-39a4320b-35b1-4836-9f8f-e9d56435d4fd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.789205 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-39a4320b-35b1-4836-9f8f-e9d56435d4fd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.790234 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-39a4320b-35b1-4836-9f8f-e9d56435d4fd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.790660 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-39a4320b-35b1-4836-9f8f-e9d56435d4fd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.928714 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-be07eef8-899e-4169-bb5c-f3f0545c81c9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:35.945048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-be07eef8-899e-4169-bb5c-f3f0545c81c9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1550 microversion: 2.1 time: 0.311803 Oct 28 08:42:35.947050 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 234/523] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:35 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1550 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:35.975952 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b8bbb3de-fe4d-40a8-a999-a3db4a488e7b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:35.977483 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b8bbb3de-fe4d-40a8-a999-a3db4a488e7b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:35.988078 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b8bbb3de-fe4d-40a8-a999-a3db4a488e7b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.990474 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b8bbb3de-fe4d-40a8-a999-a3db4a488e7b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.993182 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b8bbb3de-fe4d-40a8-a999-a3db4a488e7b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.994166 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b8bbb3de-fe4d-40a8-a999-a3db4a488e7b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.186277 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-39a4320b-35b1-4836-9f8f-e9d56435d4fd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:36.198190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-39a4320b-35b1-4836-9f8f-e9d56435d4fd tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.443863 Oct 28 08:42:36.199287 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 290/524] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:35 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:36.302585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-429f23f0-dd63-4bf1-976b-078fa5c65540 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:36.303683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-429f23f0-dd63-4bf1-976b-078fa5c65540 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:36.322469 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-429f23f0-dd63-4bf1-976b-078fa5c65540 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.323229 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-429f23f0-dd63-4bf1-976b-078fa5c65540 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.326961 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-429f23f0-dd63-4bf1-976b-078fa5c65540 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.328800 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-429f23f0-dd63-4bf1-976b-078fa5c65540 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.333641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b8bbb3de-fe4d-40a8-a999-a3db4a488e7b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:36.346131 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b8bbb3de-fe4d-40a8-a999-a3db4a488e7b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1550 microversion: 2.1 time: 0.377676 Oct 28 08:42:36.346896 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 235/525] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:35 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1550 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:36.351858 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9ba7783a-3842-4e6a-9bd2-7747fff023db tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:36.352351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9ba7783a-3842-4e6a-9bd2-7747fff023db tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:36.374171 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9ba7783a-3842-4e6a-9bd2-7747fff023db tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.374718 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9ba7783a-3842-4e6a-9bd2-7747fff023db tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.375661 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9ba7783a-3842-4e6a-9bd2-7747fff023db tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.376158 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9ba7783a-3842-4e6a-9bd2-7747fff023db tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.414140 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9ba7783a-3842-4e6a-9bd2-7747fff023db tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:42:36.428789 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-429f23f0-dd63-4bf1-976b-078fa5c65540 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.130143 Oct 28 08:42:36.435431 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 291/526] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:36 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:36.442137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1bc0c0d7-61cb-41f4-871b-86feddc1d42f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:36.455598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:36.455598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:42:36.462603 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-1bc0c0d7-61cb-41f4-871b-86feddc1d42f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:36.463770 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1bc0c0d7-61cb-41f4-871b-86feddc1d42f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Searching by: {'deleted': False, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747'} {{(pid=132797) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 28 08:42:36.486590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1bc0c0d7-61cb-41f4-871b-86feddc1d42f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.487139 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1bc0c0d7-61cb-41f4-871b-86feddc1d42f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.489424 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1bc0c0d7-61cb-41f4-871b-86feddc1d42f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.502435 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1bc0c0d7-61cb-41f4-871b-86feddc1d42f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.574299 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9ba7783a-3842-4e6a-9bd2-7747fff023db tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "DELETE /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 204 len: 0 microversion: 2.1 time: 0.226149 Oct 28 08:42:36.575062 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 236/527] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:42:36 2021] DELETE /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:42:36.581121 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b082c153-b515-426a-8f7c-1ec80a79ba8d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:36.582360 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b082c153-b515-426a-8f7c-1ec80a79ba8d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:36.591046 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b082c153-b515-426a-8f7c-1ec80a79ba8d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.591483 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b082c153-b515-426a-8f7c-1ec80a79ba8d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.592373 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b082c153-b515-426a-8f7c-1ec80a79ba8d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.592731 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b082c153-b515-426a-8f7c-1ec80a79ba8d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.696073 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.multi_cell_list [None req-1bc0c0d7-61cb-41f4-871b-86feddc1d42f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132797) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 28 08:42:36.704973 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b082c153-b515-426a-8f7c-1ec80a79ba8d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 27941 microversion: 2.20 time: 0.128340 Oct 28 08:42:36.705651 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 237/528] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:36 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 27941 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:36.713892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-59fe621a-ff68-4d89-8a4d-426d71e0f157 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:36.715258 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-59fe621a-ff68-4d89-8a4d-426d71e0f157 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:36.723106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-59fe621a-ff68-4d89-8a4d-426d71e0f157 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.723805 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-59fe621a-ff68-4d89-8a4d-426d71e0f157 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.724889 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-59fe621a-ff68-4d89-8a4d-426d71e0f157 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.725333 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-59fe621a-ff68-4d89-8a4d-426d71e0f157 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.850700 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1bc0c0d7-61cb-41f4-871b-86feddc1d42f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.413640 Oct 28 08:42:36.851883 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 292/529] 10.222.0.74 () {58 vars in 1124 bytes} [Thu Oct 28 08:42:36 2021] GET /compute/v2.1/servers => generated 343 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:36.858282 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-69157a14-415e-4448-8d8b-352827df3013 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:36.859533 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-69157a14-415e-4448-8d8b-352827df3013 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] [instance: fb953696-803c-4e65-817a-a00f31b18289] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:36.867543 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69157a14-415e-4448-8d8b-352827df3013 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.868122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69157a14-415e-4448-8d8b-352827df3013 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.868906 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69157a14-415e-4448-8d8b-352827df3013 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.870122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69157a14-415e-4448-8d8b-352827df3013 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.887565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-69157a14-415e-4448-8d8b-352827df3013 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] HTTP exception thrown: Instance fb953696-803c-4e65-817a-a00f31b18289 could not be found. Oct 28 08:42:36.887565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-69157a14-415e-4448-8d8b-352827df3013 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] Returning 404 to user: Instance fb953696-803c-4e65-817a-a00f31b18289 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:42:36.888067 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-69157a14-415e-4448-8d8b-352827df3013 tempest-VolumesNegativeTest-99203070 tempest-VolumesNegativeTest-99203070-project] 10.222.0.74 "GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289" status: 404 len: 111 microversion: 2.1 time: 0.035154 Oct 28 08:42:36.892025 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 293/530] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:36 2021] GET /compute/v2.1/servers/fb953696-803c-4e65-817a-a00f31b18289 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:42:36.904342 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-83089276-f3dc-4161-b3f9-1db6a35ec019 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:36.904724 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-83089276-f3dc-4161-b3f9-1db6a35ec019 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:36.910920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-83089276-f3dc-4161-b3f9-1db6a35ec019 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.911620 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-83089276-f3dc-4161-b3f9-1db6a35ec019 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.912487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-83089276-f3dc-4161-b3f9-1db6a35ec019 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:36.912920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-83089276-f3dc-4161-b3f9-1db6a35ec019 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:36.925028 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-59fe621a-ff68-4d89-8a4d-426d71e0f157 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:36.936764 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-59fe621a-ff68-4d89-8a4d-426d71e0f157 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1512 microversion: 2.1 time: 0.229553 Oct 28 08:42:36.940591 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 238/531] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:36 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:37.089818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-83089276-f3dc-4161-b3f9-1db6a35ec019 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:37.100272 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-83089276-f3dc-4161-b3f9-1db6a35ec019 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1550 microversion: 2.1 time: 0.209975 Oct 28 08:42:37.106599 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 294/532] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:36 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1550 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:37.227214 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0d08fe29-6eb2-481a-85cc-101434b22d54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:37.229044 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0d08fe29-6eb2-481a-85cc-101434b22d54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:37.244260 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d08fe29-6eb2-481a-85cc-101434b22d54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:37.247748 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d08fe29-6eb2-481a-85cc-101434b22d54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:37.249068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d08fe29-6eb2-481a-85cc-101434b22d54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:37.249531 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d08fe29-6eb2-481a-85cc-101434b22d54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:37.443666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-412185aa-6304-4114-9adf-d6f8ff5c2c22 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:37.447263 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-412185aa-6304-4114-9adf-d6f8ff5c2c22 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:37.455306 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-412185aa-6304-4114-9adf-d6f8ff5c2c22 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:37.456114 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-412185aa-6304-4114-9adf-d6f8ff5c2c22 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:37.457118 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-412185aa-6304-4114-9adf-d6f8ff5c2c22 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:37.457847 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-412185aa-6304-4114-9adf-d6f8ff5c2c22 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:37.462411 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0d08fe29-6eb2-481a-85cc-101434b22d54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:37.471544 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0d08fe29-6eb2-481a-85cc-101434b22d54 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.256506 Oct 28 08:42:37.484744 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 239/533] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:37 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:37.580472 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-412185aa-6304-4114-9adf-d6f8ff5c2c22 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.141141 Oct 28 08:42:37.581665 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 295/534] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:37 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:37.717695 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e437ae36-c427-4460-a09e-3e4226c97a1b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:37.719780 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e437ae36-c427-4460-a09e-3e4226c97a1b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:37.732894 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e437ae36-c427-4460-a09e-3e4226c97a1b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:37.735427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e437ae36-c427-4460-a09e-3e4226c97a1b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:37.738264 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e437ae36-c427-4460-a09e-3e4226c97a1b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:37.740719 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e437ae36-c427-4460-a09e-3e4226c97a1b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:37.862621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e437ae36-c427-4460-a09e-3e4226c97a1b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28050 microversion: 2.20 time: 0.148120 Oct 28 08:42:37.867840 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 240/535] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:37 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28050 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:37.956839 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ae27f22b-f92a-47b7-90dc-d2caa6b47953 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:37.958233 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ae27f22b-f92a-47b7-90dc-d2caa6b47953 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:37.976918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae27f22b-f92a-47b7-90dc-d2caa6b47953 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:37.977517 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae27f22b-f92a-47b7-90dc-d2caa6b47953 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:37.978415 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae27f22b-f92a-47b7-90dc-d2caa6b47953 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:37.978851 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae27f22b-f92a-47b7-90dc-d2caa6b47953 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:38.160265 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ae27f22b-f92a-47b7-90dc-d2caa6b47953 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:38.172719 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ae27f22b-f92a-47b7-90dc-d2caa6b47953 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1512 microversion: 2.1 time: 0.219754 Oct 28 08:42:38.173419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 296/536] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:37 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:38.493534 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ebab51cc-377a-4187-976d-1554280c9690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:38.495088 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ebab51cc-377a-4187-976d-1554280c9690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:38.503736 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ebab51cc-377a-4187-976d-1554280c9690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:38.504213 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ebab51cc-377a-4187-976d-1554280c9690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:38.513537 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ebab51cc-377a-4187-976d-1554280c9690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:38.514457 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ebab51cc-377a-4187-976d-1554280c9690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:38.594156 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6fa1c96b-88b0-43a6-93ea-91684f015a3f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:38.595754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6fa1c96b-88b0-43a6-93ea-91684f015a3f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:38.617194 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fa1c96b-88b0-43a6-93ea-91684f015a3f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:38.618781 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fa1c96b-88b0-43a6-93ea-91684f015a3f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:38.622359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fa1c96b-88b0-43a6-93ea-91684f015a3f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:38.622916 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fa1c96b-88b0-43a6-93ea-91684f015a3f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:38.769490 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6fa1c96b-88b0-43a6-93ea-91684f015a3f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.179948 Oct 28 08:42:38.770245 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 297/537] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:38 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:38.808685 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ebab51cc-377a-4187-976d-1554280c9690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:38.818021 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ebab51cc-377a-4187-976d-1554280c9690 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.330144 Oct 28 08:42:38.818607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 241/538] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:38 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:38.875915 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-343e981f-8edb-42b1-8ba8-167ab7c47ccd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:38.876937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-343e981f-8edb-42b1-8ba8-167ab7c47ccd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:38.894531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-343e981f-8edb-42b1-8ba8-167ab7c47ccd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:38.894931 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-343e981f-8edb-42b1-8ba8-167ab7c47ccd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:38.895764 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-343e981f-8edb-42b1-8ba8-167ab7c47ccd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:38.896275 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-343e981f-8edb-42b1-8ba8-167ab7c47ccd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:39.014737 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-222ab50f-294a-4119-80fa-fbeefcddab0c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "484cb76b-4a59-48cf-bf3c-ba97f486e8e8"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:39.015804 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-222ab50f-294a-4119-80fa-fbeefcddab0c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:39.023560 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-222ab50f-294a-4119-80fa-fbeefcddab0c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:39.024015 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-222ab50f-294a-4119-80fa-fbeefcddab0c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:39.024864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-222ab50f-294a-4119-80fa-fbeefcddab0c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:39.025299 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-222ab50f-294a-4119-80fa-fbeefcddab0c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:39.049230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-343e981f-8edb-42b1-8ba8-167ab7c47ccd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.177460 Oct 28 08:42:39.050261 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 298/539] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:38 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:39.192228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fb1722f4-75b2-4143-8ccd-58041df6996e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:39.193723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fb1722f4-75b2-4143-8ccd-58041df6996e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:39.208959 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb1722f4-75b2-4143-8ccd-58041df6996e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:39.209415 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb1722f4-75b2-4143-8ccd-58041df6996e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:39.210244 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb1722f4-75b2-4143-8ccd-58041df6996e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:39.212883 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb1722f4-75b2-4143-8ccd-58041df6996e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:39.396880 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fb1722f4-75b2-4143-8ccd-58041df6996e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:39.405584 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fb1722f4-75b2-4143-8ccd-58041df6996e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1512 microversion: 2.1 time: 0.218130 Oct 28 08:42:39.406936 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 299/540] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:39 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:39.434144 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-222ab50f-294a-4119-80fa-fbeefcddab0c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "POST /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422932 Oct 28 08:42:39.438408 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 242/541] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:42:39 2021] POST /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:42:39.785071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-be340c02-412f-484e-9cdb-b8ae7ee15e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:39.786769 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-be340c02-412f-484e-9cdb-b8ae7ee15e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:39.798626 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be340c02-412f-484e-9cdb-b8ae7ee15e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:39.799066 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be340c02-412f-484e-9cdb-b8ae7ee15e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:39.799840 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be340c02-412f-484e-9cdb-b8ae7ee15e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:39.800271 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be340c02-412f-484e-9cdb-b8ae7ee15e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:39.840909 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-90d707b2-b5dc-4d81-bb44-8c7dcd7af173 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:39.842261 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-90d707b2-b5dc-4d81-bb44-8c7dcd7af173 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:39.852687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-90d707b2-b5dc-4d81-bb44-8c7dcd7af173 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:39.858399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-90d707b2-b5dc-4d81-bb44-8c7dcd7af173 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:39.859501 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-90d707b2-b5dc-4d81-bb44-8c7dcd7af173 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:39.860177 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-90d707b2-b5dc-4d81-bb44-8c7dcd7af173 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:39.947764 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-be340c02-412f-484e-9cdb-b8ae7ee15e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.166399 Oct 28 08:42:39.948444 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 300/542] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:39 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:40.067320 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0bc183ad-1790-414e-a6e7-ecb02962c615 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:40.069359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0bc183ad-1790-414e-a6e7-ecb02962c615 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:40.111612 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0bc183ad-1790-414e-a6e7-ecb02962c615 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.115913 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0bc183ad-1790-414e-a6e7-ecb02962c615 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.119707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0bc183ad-1790-414e-a6e7-ecb02962c615 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.120413 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0bc183ad-1790-414e-a6e7-ecb02962c615 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.165421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-90d707b2-b5dc-4d81-bb44-8c7dcd7af173 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:40.180907 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-90d707b2-b5dc-4d81-bb44-8c7dcd7af173 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.339755 Oct 28 08:42:40.185267 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 243/543] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:39 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:40.240598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0bc183ad-1790-414e-a6e7-ecb02962c615 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.180035 Oct 28 08:42:40.241473 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 301/544] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:40 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:40.428877 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e7609720-e0ac-413a-9599-93110a1f1354 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:40.429977 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e7609720-e0ac-413a-9599-93110a1f1354 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:40.443850 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7609720-e0ac-413a-9599-93110a1f1354 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.449944 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7609720-e0ac-413a-9599-93110a1f1354 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.452451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7609720-e0ac-413a-9599-93110a1f1354 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.453291 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e7609720-e0ac-413a-9599-93110a1f1354 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.457433 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-ef69d550-1dee-4296-9a8e-8d8be43b48aa req-ef252dac-7d10-42ab-84c6-7eb520e32da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587", "name": "network-vif-deleted", "tag": "67050f04-b58e-4ffc-af8a-21a4e8404719"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:40.463327 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:40.463327 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:42:40.472696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-ef69d550-1dee-4296-9a8e-8d8be43b48aa req-ef252dac-7d10-42ab-84c6-7eb520e32da5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.474035 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-ef69d550-1dee-4296-9a8e-8d8be43b48aa req-ef252dac-7d10-42ab-84c6-7eb520e32da5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.492862 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-ef69d550-1dee-4296-9a8e-8d8be43b48aa req-ef252dac-7d10-42ab-84c6-7eb520e32da5 service nova] Creating event network-vif-deleted:67050f04-b58e-4ffc-af8a-21a4e8404719 for instance 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 on hv-cinder-81566 Oct 28 08:42:40.501734 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-ef69d550-1dee-4296-9a8e-8d8be43b48aa req-ef252dac-7d10-42ab-84c6-7eb520e32da5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050506 Oct 28 08:42:40.502366 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 302/545] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:40.579969 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e7609720-e0ac-413a-9599-93110a1f1354 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:40.600753 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e7609720-e0ac-413a-9599-93110a1f1354 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 200 len: 1470 microversion: 2.1 time: 0.179015 Oct 28 08:42:40.601987 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 244/546] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:40 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:40.969766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d8ca0fa1-a498-4c76-a40f-80712f55354c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:40.971666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d8ca0fa1-a498-4c76-a40f-80712f55354c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:40.988890 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d8ca0fa1-a498-4c76-a40f-80712f55354c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.990618 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d8ca0fa1-a498-4c76-a40f-80712f55354c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.993092 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d8ca0fa1-a498-4c76-a40f-80712f55354c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.993978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d8ca0fa1-a498-4c76-a40f-80712f55354c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.093542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d8ca0fa1-a498-4c76-a40f-80712f55354c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.136813 Oct 28 08:42:41.096235 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 303/547] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:40 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:41.200088 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-24144647-d4e9-4000-8f1b-fd4d64acda41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:41.201160 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-24144647-d4e9-4000-8f1b-fd4d64acda41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:41.214430 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-24144647-d4e9-4000-8f1b-fd4d64acda41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.215130 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-24144647-d4e9-4000-8f1b-fd4d64acda41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.216884 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-24144647-d4e9-4000-8f1b-fd4d64acda41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.217989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-24144647-d4e9-4000-8f1b-fd4d64acda41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.252961 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-68844b7e-0ebe-4a3e-a7d2-a15f1a3905d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:41.254345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-68844b7e-0ebe-4a3e-a7d2-a15f1a3905d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:41.274846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68844b7e-0ebe-4a3e-a7d2-a15f1a3905d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.290365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68844b7e-0ebe-4a3e-a7d2-a15f1a3905d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.291652 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68844b7e-0ebe-4a3e-a7d2-a15f1a3905d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.292495 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68844b7e-0ebe-4a3e-a7d2-a15f1a3905d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.388342 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-68844b7e-0ebe-4a3e-a7d2-a15f1a3905d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.139276 Oct 28 08:42:41.389375 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 304/548] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:41 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:41.438250 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-24144647-d4e9-4000-8f1b-fd4d64acda41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:41.452529 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-24144647-d4e9-4000-8f1b-fd4d64acda41 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.257530 Oct 28 08:42:41.453623 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 245/549] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:41 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:41.620491 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9b0734e9-cca5-4e08-b0e9-55e17747ee74 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:41.621397 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9b0734e9-cca5-4e08-b0e9-55e17747ee74 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:41.632711 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b0734e9-cca5-4e08-b0e9-55e17747ee74 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.634075 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b0734e9-cca5-4e08-b0e9-55e17747ee74 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.635432 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b0734e9-cca5-4e08-b0e9-55e17747ee74 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.636185 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b0734e9-cca5-4e08-b0e9-55e17747ee74 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.667604 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-9b0734e9-cca5-4e08-b0e9-55e17747ee74 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] HTTP exception thrown: Instance 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 could not be found. Oct 28 08:42:41.669025 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9b0734e9-cca5-4e08-b0e9-55e17747ee74 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Returning 404 to user: Instance 7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:42:41.670077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9b0734e9-cca5-4e08-b0e9-55e17747ee74 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587" status: 404 len: 111 microversion: 2.1 time: 0.054004 Oct 28 08:42:41.674764 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 305/550] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:41 2021] GET /compute/v2.1/servers/7ea2316f-bdd3-4b2c-9f4d-fba4f33bc587 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:42:42.113161 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f136638f-b1c3-4c18-ba38-faf50282520e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:42.114853 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f136638f-b1c3-4c18-ba38-faf50282520e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:42.133476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f136638f-b1c3-4c18-ba38-faf50282520e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.134236 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f136638f-b1c3-4c18-ba38-faf50282520e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.135629 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f136638f-b1c3-4c18-ba38-faf50282520e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.136276 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f136638f-b1c3-4c18-ba38-faf50282520e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.218626 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f136638f-b1c3-4c18-ba38-faf50282520e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.115450 Oct 28 08:42:42.224351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 246/551] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:42 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:42.403582 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-92263e7e-2fbc-4a72-804c-f15f07a38702 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:42.404825 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-92263e7e-2fbc-4a72-804c-f15f07a38702 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:42.419318 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-92263e7e-2fbc-4a72-804c-f15f07a38702 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.419763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-92263e7e-2fbc-4a72-804c-f15f07a38702 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.420553 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-92263e7e-2fbc-4a72-804c-f15f07a38702 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.420981 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-92263e7e-2fbc-4a72-804c-f15f07a38702 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.472531 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bc5d5541-912e-4f5d-a57e-4da5a5c65da9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:42.474167 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bc5d5541-912e-4f5d-a57e-4da5a5c65da9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:42.481769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bc5d5541-912e-4f5d-a57e-4da5a5c65da9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.482232 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bc5d5541-912e-4f5d-a57e-4da5a5c65da9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.483203 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bc5d5541-912e-4f5d-a57e-4da5a5c65da9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.483795 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bc5d5541-912e-4f5d-a57e-4da5a5c65da9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.680649 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-bc5d5541-912e-4f5d-a57e-4da5a5c65da9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:42.697888 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bc5d5541-912e-4f5d-a57e-4da5a5c65da9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.229497 Oct 28 08:42:42.709649 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 247/552] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:42 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:43.232012 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-adb8ad51-9d00-4192-8118-a9188e3fdb42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:43.233069 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-adb8ad51-9d00-4192-8118-a9188e3fdb42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:43.239646 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-adb8ad51-9d00-4192-8118-a9188e3fdb42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.240184 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-adb8ad51-9d00-4192-8118-a9188e3fdb42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:43.241520 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-adb8ad51-9d00-4192-8118-a9188e3fdb42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.242201 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-adb8ad51-9d00-4192-8118-a9188e3fdb42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:45.131829 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-adb8ad51-9d00-4192-8118-a9188e3fdb42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 1.903160 Oct 28 08:42:45.141043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 248/553] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:43 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:45.141285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-92263e7e-2fbc-4a72-804c-f15f07a38702 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 2.741792 Oct 28 08:42:45.141890 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 306/554] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:42 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 2743 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:45.151282 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5a268871-8165-48fb-8acb-3aecc3130d1b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:45.152281 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5a268871-8165-48fb-8acb-3aecc3130d1b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:45.160958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a268871-8165-48fb-8acb-3aecc3130d1b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:45.161725 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a268871-8165-48fb-8acb-3aecc3130d1b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:45.162711 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a268871-8165-48fb-8acb-3aecc3130d1b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:45.163677 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a268871-8165-48fb-8acb-3aecc3130d1b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:45.322407 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5a268871-8165-48fb-8acb-3aecc3130d1b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:45.331395 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5a268871-8165-48fb-8acb-3aecc3130d1b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.188473 Oct 28 08:42:45.331962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 249/555] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:45 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:46.155339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6e05846a-44e7-4c0b-a419-1649898c8c3c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:46.159868 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f1e0b694-ebfc-4987-a5c4-562843aba97e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:46.160429 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f1e0b694-ebfc-4987-a5c4-562843aba97e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:46.163469 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6e05846a-44e7-4c0b-a419-1649898c8c3c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:46.171618 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e05846a-44e7-4c0b-a419-1649898c8c3c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:46.172027 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e05846a-44e7-4c0b-a419-1649898c8c3c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:46.172882 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e05846a-44e7-4c0b-a419-1649898c8c3c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:46.173321 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e05846a-44e7-4c0b-a419-1649898c8c3c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:46.180538 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f1e0b694-ebfc-4987-a5c4-562843aba97e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:46.180995 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f1e0b694-ebfc-4987-a5c4-562843aba97e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:46.181824 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f1e0b694-ebfc-4987-a5c4-562843aba97e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:46.182245 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f1e0b694-ebfc-4987-a5c4-562843aba97e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:46.988680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f1e0b694-ebfc-4987-a5c4-562843aba97e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.844490 Oct 28 08:42:46.991735 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 307/556] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:46 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:46.999578 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1acba5ad-c33d-4582-9091-d0c368cbf660 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:47.000267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1acba5ad-c33d-4582-9091-d0c368cbf660 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:47.008428 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1acba5ad-c33d-4582-9091-d0c368cbf660 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:47.008886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1acba5ad-c33d-4582-9091-d0c368cbf660 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:47.009705 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1acba5ad-c33d-4582-9091-d0c368cbf660 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:47.010165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1acba5ad-c33d-4582-9091-d0c368cbf660 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:47.054387 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6e05846a-44e7-4c0b-a419-1649898c8c3c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.903018 Oct 28 08:42:47.055999 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 250/557] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:46 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:47.197998 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-1acba5ad-c33d-4582-9091-d0c368cbf660 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:47.207258 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1acba5ad-c33d-4582-9091-d0c368cbf660 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.211786 Oct 28 08:42:47.208637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 308/558] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:46 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:48.003813 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d138639d-9891-4286-ba47-0abc795934e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:48.005872 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d138639d-9891-4286-ba47-0abc795934e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:48.014819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d138639d-9891-4286-ba47-0abc795934e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:48.015699 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d138639d-9891-4286-ba47-0abc795934e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:48.016684 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d138639d-9891-4286-ba47-0abc795934e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:48.019622 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d138639d-9891-4286-ba47-0abc795934e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:48.073003 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bda46861-8189-44e8-b226-c51ee3aef00c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:48.074359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bda46861-8189-44e8-b226-c51ee3aef00c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:48.080962 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bda46861-8189-44e8-b226-c51ee3aef00c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:48.086875 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bda46861-8189-44e8-b226-c51ee3aef00c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:48.090142 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bda46861-8189-44e8-b226-c51ee3aef00c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:48.090689 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bda46861-8189-44e8-b226-c51ee3aef00c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:48.190752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d138639d-9891-4286-ba47-0abc795934e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.190959 Oct 28 08:42:48.192087 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 251/559] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:47 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:48.201362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bda46861-8189-44e8-b226-c51ee3aef00c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.132169 Oct 28 08:42:48.202901 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 309/560] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:48 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:48.238820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b03b22d6-12f3-4c67-8303-76d5ffbdd7d5 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:48.244042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b03b22d6-12f3-4c67-8303-76d5ffbdd7d5 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:48.281685 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b03b22d6-12f3-4c67-8303-76d5ffbdd7d5 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:48.282424 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b03b22d6-12f3-4c67-8303-76d5ffbdd7d5 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:48.283669 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b03b22d6-12f3-4c67-8303-76d5ffbdd7d5 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:48.284108 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b03b22d6-12f3-4c67-8303-76d5ffbdd7d5 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:48.528190 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b03b22d6-12f3-4c67-8303-76d5ffbdd7d5 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:48.544403 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b03b22d6-12f3-4c67-8303-76d5ffbdd7d5 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.319132 Oct 28 08:42:48.545990 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 252/561] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:48 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:49.204399 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3d4052c9-67a0-4537-af99-3b806962372f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:49.206107 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3d4052c9-67a0-4537-af99-3b806962372f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:49.216476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-27e36a09-971c-4f04-ab4b-4469ad7e10ed tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:49.217732 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d4052c9-67a0-4537-af99-3b806962372f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:49.218098 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-27e36a09-971c-4f04-ab4b-4469ad7e10ed tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:49.219070 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d4052c9-67a0-4537-af99-3b806962372f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.222045 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d4052c9-67a0-4537-af99-3b806962372f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:49.224817 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d4052c9-67a0-4537-af99-3b806962372f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.235353 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-27e36a09-971c-4f04-ab4b-4469ad7e10ed tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:49.235824 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-27e36a09-971c-4f04-ab4b-4469ad7e10ed tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.236611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-27e36a09-971c-4f04-ab4b-4469ad7e10ed tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:49.237038 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-27e36a09-971c-4f04-ab4b-4469ad7e10ed tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.322091 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-27e36a09-971c-4f04-ab4b-4469ad7e10ed tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.110794 Oct 28 08:42:49.323295 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 253/562] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:49 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:49.343086 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3d4052c9-67a0-4537-af99-3b806962372f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.143111 Oct 28 08:42:49.344394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 310/563] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:49 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:49.377818 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-70acf87d-a77e-4d06-b8c3-a131d17cf741 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:49.379451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-70acf87d-a77e-4d06-b8c3-a131d17cf741 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:49.392532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-70acf87d-a77e-4d06-b8c3-a131d17cf741 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:49.393507 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-70acf87d-a77e-4d06-b8c3-a131d17cf741 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.394474 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-70acf87d-a77e-4d06-b8c3-a131d17cf741 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:49.395062 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-70acf87d-a77e-4d06-b8c3-a131d17cf741 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.567833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-70acf87d-a77e-4d06-b8c3-a131d17cf741 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:49.574415 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-102ff17e-6f79-42c9-8a25-d29bb5b27aa9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:49.575385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-102ff17e-6f79-42c9-8a25-d29bb5b27aa9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:49.578353 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-70acf87d-a77e-4d06-b8c3-a131d17cf741 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1596 microversion: 2.1 time: 0.206486 Oct 28 08:42:49.579493 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 254/564] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:49 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1596 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:49.583877 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-102ff17e-6f79-42c9-8a25-d29bb5b27aa9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:49.584716 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-102ff17e-6f79-42c9-8a25-d29bb5b27aa9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.585648 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-102ff17e-6f79-42c9-8a25-d29bb5b27aa9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:49.586252 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-102ff17e-6f79-42c9-8a25-d29bb5b27aa9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.792302 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-102ff17e-6f79-42c9-8a25-d29bb5b27aa9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:49.804400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-102ff17e-6f79-42c9-8a25-d29bb5b27aa9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.238326 Oct 28 08:42:49.804982 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 311/565] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:49 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:50.337463 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6f639b60-6c41-4b6a-8eca-65df9e57366c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:50.339962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6f639b60-6c41-4b6a-8eca-65df9e57366c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:50.351084 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f639b60-6c41-4b6a-8eca-65df9e57366c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:50.351961 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f639b60-6c41-4b6a-8eca-65df9e57366c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:50.353888 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f639b60-6c41-4b6a-8eca-65df9e57366c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:50.354630 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f639b60-6c41-4b6a-8eca-65df9e57366c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:50.358022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ae6c470d-c8fb-4a40-9d74-1e415769f41f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:50.358946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ae6c470d-c8fb-4a40-9d74-1e415769f41f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:50.367680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae6c470d-c8fb-4a40-9d74-1e415769f41f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:50.368129 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae6c470d-c8fb-4a40-9d74-1e415769f41f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:50.368918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae6c470d-c8fb-4a40-9d74-1e415769f41f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:50.369346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae6c470d-c8fb-4a40-9d74-1e415769f41f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.070653 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6f639b60-6c41-4b6a-8eca-65df9e57366c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 4.739318 Oct 28 08:42:55.071315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 255/566] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:50 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 4742 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:55.076152 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e79da124-7802-4ddc-b665-9b63ff72d110 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:55.076854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e79da124-7802-4ddc-b665-9b63ff72d110 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:55.082542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ae6c470d-c8fb-4a40-9d74-1e415769f41f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 4.728496 Oct 28 08:42:55.084399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e79da124-7802-4ddc-b665-9b63ff72d110 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.087730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e79da124-7802-4ddc-b665-9b63ff72d110 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.087879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 312/567] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:50 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 4732 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:55.087991 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e79da124-7802-4ddc-b665-9b63ff72d110 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.087991 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e79da124-7802-4ddc-b665-9b63ff72d110 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.090716 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-7cbe7116-b3a8-4973-9e52-d78187f09716 req-dd37761a-eccf-4bd0-a97b-12713c7908b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50b0126-b6b3-4fbf-8596-0f7b3d5877f6", "tag": "760c9603-2fe5-4dc3-aa4c-7ff255fee93d"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:55.092547 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:55.092547 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:42:55.101706 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-7cbe7116-b3a8-4973-9e52-d78187f09716 req-dd37761a-eccf-4bd0-a97b-12713c7908b4 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.102190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-7cbe7116-b3a8-4973-9e52-d78187f09716 req-dd37761a-eccf-4bd0-a97b-12713c7908b4 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.114565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-7cbe7116-b3a8-4973-9e52-d78187f09716 req-dd37761a-eccf-4bd0-a97b-12713c7908b4 service nova] Creating event network-changed:760c9603-2fe5-4dc3-aa4c-7ff255fee93d for instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 on hv-cinder-81566 Oct 28 08:42:55.119684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-7cbe7116-b3a8-4973-9e52-d78187f09716 req-dd37761a-eccf-4bd0-a97b-12713c7908b4 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033315 Oct 28 08:42:55.120276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 313/568] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:55.126696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2c4cf001-ca48-4393-8d2b-2445d5d7e955 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-886198110"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:55.127326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2c4cf001-ca48-4393-8d2b-2445d5d7e955 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:55.134407 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c4cf001-ca48-4393-8d2b-2445d5d7e955 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.134871 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c4cf001-ca48-4393-8d2b-2445d5d7e955 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.135705 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c4cf001-ca48-4393-8d2b-2445d5d7e955 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.136231 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2c4cf001-ca48-4393-8d2b-2445d5d7e955 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.298941 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e79da124-7802-4ddc-b665-9b63ff72d110 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:55.306802 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e79da124-7802-4ddc-b665-9b63ff72d110 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.234341 Oct 28 08:42:55.307372 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 256/569] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:55 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:55.351068 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.network.security_group_api [None req-2c4cf001-ca48-4393-8d2b-2445d5d7e955 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Adding security group 4cb6ddd4-447a-4a7f-bc35-00f119c992ee to port 760c9603-2fe5-4dc3-aa4c-7ff255fee93d Oct 28 08:42:55.997874 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2c4cf001-ca48-4393-8d2b-2445d5d7e955 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "POST /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/action" status: 202 len: 0 microversion: 2.1 time: 0.876029 Oct 28 08:42:55.999266 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 314/570] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:55 2021] POST /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/action => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:56.008769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-67f78a87-6588-4b97-993d-3cc7a4fc7dee tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:56.010671 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-67f78a87-6588-4b97-993d-3cc7a4fc7dee tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:56.021385 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-67f78a87-6588-4b97-993d-3cc7a4fc7dee tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.026623 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-67f78a87-6588-4b97-993d-3cc7a4fc7dee tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.027809 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-67f78a87-6588-4b97-993d-3cc7a4fc7dee tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.028521 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-67f78a87-6588-4b97-993d-3cc7a4fc7dee tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.082365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ab1b4193-e0ae-4424-b103-5a18d7875d9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:56.083575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ab1b4193-e0ae-4424-b103-5a18d7875d9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:56.090763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab1b4193-e0ae-4424-b103-5a18d7875d9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.091499 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab1b4193-e0ae-4424-b103-5a18d7875d9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.092520 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab1b4193-e0ae-4424-b103-5a18d7875d9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.093152 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab1b4193-e0ae-4424-b103-5a18d7875d9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.250970 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-67f78a87-6588-4b97-993d-3cc7a4fc7dee tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:56.260980 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-67f78a87-6588-4b97-993d-3cc7a4fc7dee tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1642 microversion: 2.1 time: 0.256944 Oct 28 08:42:56.262036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 257/571] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:56 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1642 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:56.267042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-748b3512-891e-427f-95cd-97e37079b101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:56.268011 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-748b3512-891e-427f-95cd-97e37079b101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:56.274690 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-748b3512-891e-427f-95cd-97e37079b101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.275194 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-748b3512-891e-427f-95cd-97e37079b101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.276048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-748b3512-891e-427f-95cd-97e37079b101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.276797 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-748b3512-891e-427f-95cd-97e37079b101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.295680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ab1b4193-e0ae-4424-b103-5a18d7875d9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.216799 Oct 28 08:42:56.296345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 315/572] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:56 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:56.305739 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1118840471", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "networks": [{"uuid": "99f80582-49be-48b4-8fdc-c145bb74ebac"}]}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:56.354049 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-748b3512-891e-427f-95cd-97e37079b101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.087088 Oct 28 08:42:56.354766 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 258/573] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:56 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:56.360565 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5eed242d-18c4-404e-ae9e-10f540cf58c1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:56.361444 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5eed242d-18c4-404e-ae9e-10f540cf58c1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:56.363548 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.network.neutron [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] validate_networks() for [('99f80582-49be-48b4-8fdc-c145bb74ebac', None, None, None, None, None)] {{(pid=132797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:42:56.370257 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5eed242d-18c4-404e-ae9e-10f540cf58c1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.370963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5eed242d-18c4-404e-ae9e-10f540cf58c1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.371727 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5eed242d-18c4-404e-ae9e-10f540cf58c1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.372157 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5eed242d-18c4-404e-ae9e-10f540cf58c1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.578866 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5eed242d-18c4-404e-ae9e-10f540cf58c1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:56.588882 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5eed242d-18c4-404e-ae9e-10f540cf58c1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.231701 Oct 28 08:42:56.588882 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 259/574] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:56 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:56.804800 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Flavor limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:42:56.805232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Image limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:42:56.805703 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Flavor pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:42:56.806241 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Image pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:42:56.806672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:42:56.816349 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.817458 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.818563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.819816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.838290 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Getting quotas for project 5d151ada161c47d4ae433054a67cdb95. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:42:56.842293 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Getting quotas for user 4cde6e14d5b2432a918c5ffd26dc8335 and project 5d151ada161c47d4ae433054a67cdb95. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:42:56.853982 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Going to run 1 instances... {{(pid=132797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:42:56.856484 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:42:56.905521 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-88c25346-4ded-4f7b-839f-48117f40040b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607619 Oct 28 08:42:56.906283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 316/575] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:42:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:42:56.916612 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0bfec3a4-9cd2-4961-88d3-431b5191556f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:56.917194 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0bfec3a4-9cd2-4961-88d3-431b5191556f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:56.985639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0bfec3a4-9cd2-4961-88d3-431b5191556f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:56.995933 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0bfec3a4-9cd2-4961-88d3-431b5191556f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1219 microversion: 2.1 time: 0.081583 Oct 28 08:42:57.005387 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 260/576] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:56 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:57.136191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-9a24cbf0-31e6-4751-b846-55211f892461 req-368dc799-5a6e-4f3b-afd5-82944bfab8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50b0126-b6b3-4fbf-8596-0f7b3d5877f6", "tag": "760c9603-2fe5-4dc3-aa4c-7ff255fee93d"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:57.137440 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:57.137440 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:42:57.145182 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-9a24cbf0-31e6-4751-b846-55211f892461 req-368dc799-5a6e-4f3b-afd5-82944bfab8d4 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.145717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-9a24cbf0-31e6-4751-b846-55211f892461 req-368dc799-5a6e-4f3b-afd5-82944bfab8d4 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.157024 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-9a24cbf0-31e6-4751-b846-55211f892461 req-368dc799-5a6e-4f3b-afd5-82944bfab8d4 service nova] Creating event network-changed:760c9603-2fe5-4dc3-aa4c-7ff255fee93d for instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 on hv-cinder-81566 Oct 28 08:42:57.162692 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-9a24cbf0-31e6-4751-b846-55211f892461 req-368dc799-5a6e-4f3b-afd5-82944bfab8d4 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030885 Oct 28 08:42:57.166759 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 317/577] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:57.310943 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d6e6c3d6-c46c-4c39-adde-00173312cbc7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:57.313021 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d6e6c3d6-c46c-4c39-adde-00173312cbc7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:57.322460 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d6e6c3d6-c46c-4c39-adde-00173312cbc7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.323358 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d6e6c3d6-c46c-4c39-adde-00173312cbc7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.324386 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d6e6c3d6-c46c-4c39-adde-00173312cbc7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.324883 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d6e6c3d6-c46c-4c39-adde-00173312cbc7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.368566 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-abffca90-87c6-43c7-9c69-bf767bdadbfd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:57.369656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-abffca90-87c6-43c7-9c69-bf767bdadbfd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:57.388716 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-abffca90-87c6-43c7-9c69-bf767bdadbfd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.391133 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-abffca90-87c6-43c7-9c69-bf767bdadbfd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.392766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-abffca90-87c6-43c7-9c69-bf767bdadbfd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.394126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-abffca90-87c6-43c7-9c69-bf767bdadbfd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.506149 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d6e6c3d6-c46c-4c39-adde-00173312cbc7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.198595 Oct 28 08:42:57.507515 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 261/578] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:57 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:57.509461 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-abffca90-87c6-43c7-9c69-bf767bdadbfd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.146571 Oct 28 08:42:57.510521 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 318/579] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:57 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:57.608663 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d63c9c94-9fe9-4f3b-b478-81435cb1af1d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:57.609364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d63c9c94-9fe9-4f3b-b478-81435cb1af1d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:57.617156 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d63c9c94-9fe9-4f3b-b478-81435cb1af1d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.617551 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d63c9c94-9fe9-4f3b-b478-81435cb1af1d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.618359 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d63c9c94-9fe9-4f3b-b478-81435cb1af1d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.618787 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d63c9c94-9fe9-4f3b-b478-81435cb1af1d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.840524 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d63c9c94-9fe9-4f3b-b478-81435cb1af1d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:57.848768 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d63c9c94-9fe9-4f3b-b478-81435cb1af1d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.247229 Oct 28 08:42:57.850028 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 262/580] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:57 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:58.017676 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-35662e43-35e4-42d7-b077-221f07c7be58 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:58.017676 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-35662e43-35e4-42d7-b077-221f07c7be58 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:58.023965 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35662e43-35e4-42d7-b077-221f07c7be58 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.024376 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35662e43-35e4-42d7-b077-221f07c7be58 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.025167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35662e43-35e4-42d7-b077-221f07c7be58 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.025602 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35662e43-35e4-42d7-b077-221f07c7be58 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.118150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-35662e43-35e4-42d7-b077-221f07c7be58 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:58.131969 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-35662e43-35e4-42d7-b077-221f07c7be58 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1279 microversion: 2.1 time: 0.122757 Oct 28 08:42:58.132557 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 319/581] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:58 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:58.521046 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-177ce889-02dc-4773-a0f1-e055c330b8f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:58.521841 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-177ce889-02dc-4773-a0f1-e055c330b8f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:58.523399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c72b382d-1c88-47bd-a5a6-6a286113d42c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:58.526695 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c72b382d-1c88-47bd-a5a6-6a286113d42c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:58.531173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-177ce889-02dc-4773-a0f1-e055c330b8f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.532804 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-177ce889-02dc-4773-a0f1-e055c330b8f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.533206 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-177ce889-02dc-4773-a0f1-e055c330b8f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.534068 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-177ce889-02dc-4773-a0f1-e055c330b8f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.549245 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c72b382d-1c88-47bd-a5a6-6a286113d42c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.550035 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c72b382d-1c88-47bd-a5a6-6a286113d42c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.551313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c72b382d-1c88-47bd-a5a6-6a286113d42c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.552293 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c72b382d-1c88-47bd-a5a6-6a286113d42c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.628309 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-177ce889-02dc-4773-a0f1-e055c330b8f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.111383 Oct 28 08:42:58.630270 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 320/582] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:58 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:58.642776 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c72b382d-1c88-47bd-a5a6-6a286113d42c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.126176 Oct 28 08:42:58.643488 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 263/583] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:58 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:58.868517 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3756580c-8f49-4f8d-8533-7c4afa7dc30f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:58.869393 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3756580c-8f49-4f8d-8533-7c4afa7dc30f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:58.876643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3756580c-8f49-4f8d-8533-7c4afa7dc30f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.877094 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3756580c-8f49-4f8d-8533-7c4afa7dc30f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.877901 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3756580c-8f49-4f8d-8533-7c4afa7dc30f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.878531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3756580c-8f49-4f8d-8533-7c4afa7dc30f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.151498 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c659d193-b9aa-4a5f-83cf-b0285808f9a1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:59.152165 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c659d193-b9aa-4a5f-83cf-b0285808f9a1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:59.159918 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c659d193-b9aa-4a5f-83cf-b0285808f9a1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.160358 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c659d193-b9aa-4a5f-83cf-b0285808f9a1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.162168 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c659d193-b9aa-4a5f-83cf-b0285808f9a1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.162896 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c659d193-b9aa-4a5f-83cf-b0285808f9a1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.537993 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3756580c-8f49-4f8d-8533-7c4afa7dc30f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:59.545984 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3756580c-8f49-4f8d-8533-7c4afa7dc30f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1566 microversion: 2.1 time: 0.682941 Oct 28 08:42:59.546570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 321/584] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:58 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1566 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:59.579344 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c659d193-b9aa-4a5f-83cf-b0285808f9a1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:59.588593 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c659d193-b9aa-4a5f-83cf-b0285808f9a1 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.442721 Oct 28 08:42:59.600584 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 264/585] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:59 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:59.641137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6720753d-a9ea-4acf-93a3-c7ac975958d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:59.642521 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6720753d-a9ea-4acf-93a3-c7ac975958d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:59.649958 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6720753d-a9ea-4acf-93a3-c7ac975958d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.650154 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6720753d-a9ea-4acf-93a3-c7ac975958d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.651003 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6720753d-a9ea-4acf-93a3-c7ac975958d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.651508 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6720753d-a9ea-4acf-93a3-c7ac975958d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.658710 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-50a6c348-7373-4f14-b4de-10c9bb6802be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:59.660037 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-50a6c348-7373-4f14-b4de-10c9bb6802be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:59.668391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50a6c348-7373-4f14-b4de-10c9bb6802be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.669149 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50a6c348-7373-4f14-b4de-10c9bb6802be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.670091 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50a6c348-7373-4f14-b4de-10c9bb6802be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.670796 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50a6c348-7373-4f14-b4de-10c9bb6802be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.768384 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-50a6c348-7373-4f14-b4de-10c9bb6802be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.116007 Oct 28 08:42:59.769641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 265/586] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:59 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:59.777926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6720753d-a9ea-4acf-93a3-c7ac975958d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.140416 Oct 28 08:42:59.778740 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 322/587] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:59 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:59.884834 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-e7c62f16-a819-4f4d-b804-ab11ff218129 req-692ed97d-d3e5-48b2-91de-c0e435ff3819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b242f3a-0fab-4607-8a43-80c4d15255c6", "tag": "b5f4ba07-a5b6-40dc-b577-c707a79bc3d0"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:59.887245 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:59.887245 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:42:59.898292 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-e7c62f16-a819-4f4d-b804-ab11ff218129 req-692ed97d-d3e5-48b2-91de-c0e435ff3819 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.899337 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-e7c62f16-a819-4f4d-b804-ab11ff218129 req-692ed97d-d3e5-48b2-91de-c0e435ff3819 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.915600 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-e7c62f16-a819-4f4d-b804-ab11ff218129 req-692ed97d-d3e5-48b2-91de-c0e435ff3819 service nova] Creating event network-changed:b5f4ba07-a5b6-40dc-b577-c707a79bc3d0 for instance 7b242f3a-0fab-4607-8a43-80c4d15255c6 on hv-cinder-81566 Oct 28 08:42:59.921223 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-e7c62f16-a819-4f4d-b804-ab11ff218129 req-692ed97d-d3e5-48b2-91de-c0e435ff3819 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041837 Oct 28 08:42:59.922227 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 266/588] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:00.564590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f00a8deb-8cd1-4c58-8865-279a34f0c7e8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:00.566311 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f00a8deb-8cd1-4c58-8865-279a34f0c7e8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:00.573630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f00a8deb-8cd1-4c58-8865-279a34f0c7e8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.574126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f00a8deb-8cd1-4c58-8865-279a34f0c7e8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.574978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f00a8deb-8cd1-4c58-8865-279a34f0c7e8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.575585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f00a8deb-8cd1-4c58-8865-279a34f0c7e8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.608414 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e2896f0b-a9f7-4e65-a824-c4174c08d5d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:00.609266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e2896f0b-a9f7-4e65-a824-c4174c08d5d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:00.617050 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2896f0b-a9f7-4e65-a824-c4174c08d5d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.617502 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2896f0b-a9f7-4e65-a824-c4174c08d5d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.618381 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2896f0b-a9f7-4e65-a824-c4174c08d5d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.618818 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2896f0b-a9f7-4e65-a824-c4174c08d5d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.787830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f00a8deb-8cd1-4c58-8865-279a34f0c7e8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:00.796979 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f00a8deb-8cd1-4c58-8865-279a34f0c7e8 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1546 microversion: 2.1 time: 0.236218 Oct 28 08:43:00.797952 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 323/589] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:00 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1546 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:00.803670 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c6db8003-1f84-438d-94f2-050cdc6ea1ae tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:00.804657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c6db8003-1f84-438d-94f2-050cdc6ea1ae tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:00.810582 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6db8003-1f84-438d-94f2-050cdc6ea1ae tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.811023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6db8003-1f84-438d-94f2-050cdc6ea1ae tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.811790 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6db8003-1f84-438d-94f2-050cdc6ea1ae tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.812206 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6db8003-1f84-438d-94f2-050cdc6ea1ae tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.814142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e2896f0b-a9f7-4e65-a824-c4174c08d5d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:00.823874 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e2896f0b-a9f7-4e65-a824-c4174c08d5d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.220081 Oct 28 08:43:00.825135 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 267/590] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:00 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:00.832002 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0ca07d45-b0c0-4be4-926e-8f0f14d731d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:00.834533 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0ca07d45-b0c0-4be4-926e-8f0f14d731d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:00.841475 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ca07d45-b0c0-4be4-926e-8f0f14d731d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.842197 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ca07d45-b0c0-4be4-926e-8f0f14d731d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.843113 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ca07d45-b0c0-4be4-926e-8f0f14d731d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.844346 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0ca07d45-b0c0-4be4-926e-8f0f14d731d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.902994 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c6db8003-1f84-438d-94f2-050cdc6ea1ae tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.103597 Oct 28 08:43:00.906952 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 324/591] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:00 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:00.909395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-17c39f32-5fc8-4fe8-b57c-33e6223427fe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:00.909989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-17c39f32-5fc8-4fe8-b57c-33e6223427fe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:00.920603 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-17c39f32-5fc8-4fe8-b57c-33e6223427fe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.921262 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-17c39f32-5fc8-4fe8-b57c-33e6223427fe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.922300 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-17c39f32-5fc8-4fe8-b57c-33e6223427fe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.922935 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-17c39f32-5fc8-4fe8-b57c-33e6223427fe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.925221 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0ca07d45-b0c0-4be4-926e-8f0f14d731d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.098164 Oct 28 08:43:00.925894 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 268/592] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:00 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:01.016555 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-17c39f32-5fc8-4fe8-b57c-33e6223427fe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] HTTP exception thrown: Cannot 'detach_volume' instance c70c146b-a5ed-43af-aad8-18fb35f2dab5 while it is in vm_state rescued Oct 28 08:43:01.017163 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-17c39f32-5fc8-4fe8-b57c-33e6223427fe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Returning 409 to user: Cannot 'detach_volume' instance c70c146b-a5ed-43af-aad8-18fb35f2dab5 while it is in vm_state rescued {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:43:01.018022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-17c39f32-5fc8-4fe8-b57c-33e6223427fe tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "DELETE /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments/1db700b7-6512-4a99-8ddb-a5eb8f5ad989" status: 409 len: 152 microversion: 2.1 time: 0.112814 Oct 28 08:43:01.018975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 325/593] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:43:00 2021] DELETE /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments/1db700b7-6512-4a99-8ddb-a5eb8f5ad989 => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 08:43:01.029595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-cbca73c2-f6eb-4f85-ab2b-d83659c09719 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:01.030418 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-cbca73c2-f6eb-4f85-ab2b-d83659c09719 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:01.037855 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cbca73c2-f6eb-4f85-ab2b-d83659c09719 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.038299 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cbca73c2-f6eb-4f85-ab2b-d83659c09719 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.039065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cbca73c2-f6eb-4f85-ab2b-d83659c09719 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.039498 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cbca73c2-f6eb-4f85-ab2b-d83659c09719 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.120022 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-cbca73c2-f6eb-4f85-ab2b-d83659c09719 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/action" status: 202 len: 0 microversion: 2.1 time: 0.095485 Oct 28 08:43:01.120811 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 269/594] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:01 2021] POST /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:01.129027 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0f418a61-0f7f-4c43-b44c-84c4cb7f66f9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:01.129967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0f418a61-0f7f-4c43-b44c-84c4cb7f66f9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:01.137332 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f418a61-0f7f-4c43-b44c-84c4cb7f66f9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.137756 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f418a61-0f7f-4c43-b44c-84c4cb7f66f9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.138664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f418a61-0f7f-4c43-b44c-84c4cb7f66f9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.139151 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f418a61-0f7f-4c43-b44c-84c4cb7f66f9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.284116 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0f418a61-0f7f-4c43-b44c-84c4cb7f66f9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:01.292755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0f418a61-0f7f-4c43-b44c-84c4cb7f66f9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1554 microversion: 2.1 time: 0.167576 Oct 28 08:43:01.293657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 326/595] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:01 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:01.841906 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fa02f566-f2bd-4177-8b6a-bc71483f05d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:01.842602 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fa02f566-f2bd-4177-8b6a-bc71483f05d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:01.849577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa02f566-f2bd-4177-8b6a-bc71483f05d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.850063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa02f566-f2bd-4177-8b6a-bc71483f05d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.850872 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa02f566-f2bd-4177-8b6a-bc71483f05d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.851314 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa02f566-f2bd-4177-8b6a-bc71483f05d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.915611 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9427409a-85c3-4189-9bdc-ab32be7935a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:01.917371 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9427409a-85c3-4189-9bdc-ab32be7935a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:01.923848 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9427409a-85c3-4189-9bdc-ab32be7935a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.924338 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9427409a-85c3-4189-9bdc-ab32be7935a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.925333 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9427409a-85c3-4189-9bdc-ab32be7935a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.925774 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9427409a-85c3-4189-9bdc-ab32be7935a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.991812 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fa02f566-f2bd-4177-8b6a-bc71483f05d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:01.999271 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fa02f566-f2bd-4177-8b6a-bc71483f05d4 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.161469 Oct 28 08:43:01.999834 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 270/596] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:01 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:02.002391 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9427409a-85c3-4189-9bdc-ab32be7935a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.091077 Oct 28 08:43:02.003564 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 327/597] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:01 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:02.004361 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b559c6e6-c83c-4468-9384-21dd4d352bf1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:02.005477 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b559c6e6-c83c-4468-9384-21dd4d352bf1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:02.011501 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b559c6e6-c83c-4468-9384-21dd4d352bf1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:02.011942 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b559c6e6-c83c-4468-9384-21dd4d352bf1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:02.012739 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b559c6e6-c83c-4468-9384-21dd4d352bf1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:02.013170 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b559c6e6-c83c-4468-9384-21dd4d352bf1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:02.154383 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b559c6e6-c83c-4468-9384-21dd4d352bf1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.153069 Oct 28 08:43:02.155041 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 271/598] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:02 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:02.311126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8d3cbc64-86fc-4950-8a2a-1e65faa89cde tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:02.311804 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8d3cbc64-86fc-4950-8a2a-1e65faa89cde tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:02.318724 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8d3cbc64-86fc-4950-8a2a-1e65faa89cde tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:02.319161 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8d3cbc64-86fc-4950-8a2a-1e65faa89cde tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:02.319917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8d3cbc64-86fc-4950-8a2a-1e65faa89cde tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:02.320337 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8d3cbc64-86fc-4950-8a2a-1e65faa89cde tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:02.457091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8d3cbc64-86fc-4950-8a2a-1e65faa89cde tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:02.467174 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8d3cbc64-86fc-4950-8a2a-1e65faa89cde tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1554 microversion: 2.1 time: 0.160110 Oct 28 08:43:02.467737 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 328/599] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:02 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:03.015291 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a74ed8ab-d00f-4c86-aeba-d10c5accf012 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:03.015914 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-13d8aa1d-2be8-4236-8ee0-a518cc97854f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:03.016287 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a74ed8ab-d00f-4c86-aeba-d10c5accf012 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:03.016521 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-13d8aa1d-2be8-4236-8ee0-a518cc97854f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:03.024672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-13d8aa1d-2be8-4236-8ee0-a518cc97854f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:03.025118 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-13d8aa1d-2be8-4236-8ee0-a518cc97854f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:03.025266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a74ed8ab-d00f-4c86-aeba-d10c5accf012 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:03.025586 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a74ed8ab-d00f-4c86-aeba-d10c5accf012 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:03.025975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-13d8aa1d-2be8-4236-8ee0-a518cc97854f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:03.026426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-13d8aa1d-2be8-4236-8ee0-a518cc97854f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:03.026548 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a74ed8ab-d00f-4c86-aeba-d10c5accf012 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:03.026870 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a74ed8ab-d00f-4c86-aeba-d10c5accf012 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:03.154421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-13d8aa1d-2be8-4236-8ee0-a518cc97854f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:03.162071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-13d8aa1d-2be8-4236-8ee0-a518cc97854f tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.149523 Oct 28 08:43:03.162649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 329/600] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:03 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:03.167051 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4ce1d6bd-22ad-45cd-a16a-28bfdb921d0f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:03.168065 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4ce1d6bd-22ad-45cd-a16a-28bfdb921d0f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:03.174395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ce1d6bd-22ad-45cd-a16a-28bfdb921d0f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:03.174865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ce1d6bd-22ad-45cd-a16a-28bfdb921d0f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:03.175937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ce1d6bd-22ad-45cd-a16a-28bfdb921d0f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:03.176397 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4ce1d6bd-22ad-45cd-a16a-28bfdb921d0f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.362702 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a74ed8ab-d00f-4c86-aeba-d10c5accf012 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 1.351432 Oct 28 08:43:04.367058 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 272/601] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:03 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:04.369003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ad6410f1-3d6e-4ed7-836a-ba368225bd88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:04.369699 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ad6410f1-3d6e-4ed7-836a-ba368225bd88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:04.376916 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad6410f1-3d6e-4ed7-836a-ba368225bd88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:04.377557 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad6410f1-3d6e-4ed7-836a-ba368225bd88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.378251 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad6410f1-3d6e-4ed7-836a-ba368225bd88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:04.378693 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ad6410f1-3d6e-4ed7-836a-ba368225bd88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.404117 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4ce1d6bd-22ad-45cd-a16a-28bfdb921d0f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 1.240225 Oct 28 08:43:04.405396 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 330/602] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:03 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:04.410585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f4cced68-6c06-4058-a555-ca492f8310ed tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:04.411837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f4cced68-6c06-4058-a555-ca492f8310ed tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:04.418989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f4cced68-6c06-4058-a555-ca492f8310ed tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:04.419437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f4cced68-6c06-4058-a555-ca492f8310ed tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.420223 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f4cced68-6c06-4058-a555-ca492f8310ed tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:04.420657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f4cced68-6c06-4058-a555-ca492f8310ed tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.552548 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ad6410f1-3d6e-4ed7-836a-ba368225bd88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:04.560623 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ad6410f1-3d6e-4ed7-836a-ba368225bd88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1554 microversion: 2.1 time: 0.196069 Oct 28 08:43:04.561496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 273/603] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:04 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:04.591599 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f4cced68-6c06-4058-a555-ca492f8310ed tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:04.600445 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f4cced68-6c06-4058-a555-ca492f8310ed tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.193656 Oct 28 08:43:04.601029 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 331/604] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:04 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:05.375335 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-21e35450-7fab-4fd5-97a6-43949205f5df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:05.377585 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-21e35450-7fab-4fd5-97a6-43949205f5df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:05.385312 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21e35450-7fab-4fd5-97a6-43949205f5df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:05.385814 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21e35450-7fab-4fd5-97a6-43949205f5df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:05.386563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21e35450-7fab-4fd5-97a6-43949205f5df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:05.386996 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21e35450-7fab-4fd5-97a6-43949205f5df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:05.417267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ed1b4c96-dd9a-4658-b5a5-d63d325fe4af tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:05.418232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ed1b4c96-dd9a-4658-b5a5-d63d325fe4af tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:05.425096 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed1b4c96-dd9a-4658-b5a5-d63d325fe4af tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:05.425518 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed1b4c96-dd9a-4658-b5a5-d63d325fe4af tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:05.426355 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed1b4c96-dd9a-4658-b5a5-d63d325fe4af tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:05.427281 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed1b4c96-dd9a-4658-b5a5-d63d325fe4af tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:08.823050 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-21e35450-7fab-4fd5-97a6-43949205f5df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 3.451699 Oct 28 08:43:08.824138 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 274/605] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:05 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 3454 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:08.828023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ed1b4c96-dd9a-4658-b5a5-d63d325fe4af tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 3.415264 Oct 28 08:43:08.828886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 332/606] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:05 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 3417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:08.829020 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-406dba5d-e64f-468d-adba-e019c8d9386b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:08.829768 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-406dba5d-e64f-468d-adba-e019c8d9386b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:08.834261 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3705d986-2d52-4203-8611-d80f25c40e59 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:08.834976 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3705d986-2d52-4203-8611-d80f25c40e59 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:08.837516 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-406dba5d-e64f-468d-adba-e019c8d9386b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:08.837967 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-406dba5d-e64f-468d-adba-e019c8d9386b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:08.838693 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-406dba5d-e64f-468d-adba-e019c8d9386b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:08.839123 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-406dba5d-e64f-468d-adba-e019c8d9386b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:08.842106 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3705d986-2d52-4203-8611-d80f25c40e59 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:08.842557 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3705d986-2d52-4203-8611-d80f25c40e59 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:08.843336 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3705d986-2d52-4203-8611-d80f25c40e59 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:08.843792 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3705d986-2d52-4203-8611-d80f25c40e59 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.027833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-406dba5d-e64f-468d-adba-e019c8d9386b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:09.034477 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3705d986-2d52-4203-8611-d80f25c40e59 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:09.035749 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-406dba5d-e64f-468d-adba-e019c8d9386b tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1554 microversion: 2.1 time: 0.210449 Oct 28 08:43:09.037778 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 275/607] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:08 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:09.043180 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3705d986-2d52-4203-8611-d80f25c40e59 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.213038 Oct 28 08:43:09.043867 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 333/608] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:08 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:09.835574 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fbcf04f6-41b0-4a5b-b449-022e524d96c1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:09.836486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fbcf04f6-41b0-4a5b-b449-022e524d96c1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:09.840996 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d0c39218-a29b-4a2b-9c0c-a63966f49770 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:09.841930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d0c39218-a29b-4a2b-9c0c-a63966f49770 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:09.843125 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fbcf04f6-41b0-4a5b-b449-022e524d96c1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.843580 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fbcf04f6-41b0-4a5b-b449-022e524d96c1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.844358 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fbcf04f6-41b0-4a5b-b449-022e524d96c1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.844794 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fbcf04f6-41b0-4a5b-b449-022e524d96c1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.848248 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d0c39218-a29b-4a2b-9c0c-a63966f49770 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.849427 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d0c39218-a29b-4a2b-9c0c-a63966f49770 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.850228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d0c39218-a29b-4a2b-9c0c-a63966f49770 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.850657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d0c39218-a29b-4a2b-9c0c-a63966f49770 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.960770 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d0c39218-a29b-4a2b-9c0c-a63966f49770 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.123321 Oct 28 08:43:09.963627 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 334/609] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:09 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:09.965656 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fbcf04f6-41b0-4a5b-b449-022e524d96c1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.134506 Oct 28 08:43:09.969416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 276/610] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:09 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:10.057216 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-cbf9b8c1-c95e-4677-beeb-fcc04c857163 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:10.058131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-cbf9b8c1-c95e-4677-beeb-fcc04c857163 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:10.062644 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f32ec2a6-5f86-4e4b-8a8e-038cc8ce5ee5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:10.063349 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f32ec2a6-5f86-4e4b-8a8e-038cc8ce5ee5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:10.066957 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cbf9b8c1-c95e-4677-beeb-fcc04c857163 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.068314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cbf9b8c1-c95e-4677-beeb-fcc04c857163 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.069516 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cbf9b8c1-c95e-4677-beeb-fcc04c857163 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.069972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cbf9b8c1-c95e-4677-beeb-fcc04c857163 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.071125 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f32ec2a6-5f86-4e4b-8a8e-038cc8ce5ee5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.071568 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f32ec2a6-5f86-4e4b-8a8e-038cc8ce5ee5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.072334 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f32ec2a6-5f86-4e4b-8a8e-038cc8ce5ee5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.072909 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f32ec2a6-5f86-4e4b-8a8e-038cc8ce5ee5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.250351 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-cbf9b8c1-c95e-4677-beeb-fcc04c857163 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:10.258652 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-cbf9b8c1-c95e-4677-beeb-fcc04c857163 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1554 microversion: 2.1 time: 0.207386 Oct 28 08:43:10.259454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 335/611] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:10 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1554 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:10.265929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f32ec2a6-5f86-4e4b-8a8e-038cc8ce5ee5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:10.276959 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f32ec2a6-5f86-4e4b-8a8e-038cc8ce5ee5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.219563 Oct 28 08:43:10.281820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 277/612] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:10 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:10.972901 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4a0b3c60-2b95-47d1-a7c9-f70764fdd3f6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:10.975109 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4a0b3c60-2b95-47d1-a7c9-f70764fdd3f6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:10.978296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fd0d1696-91ce-455a-b3da-c8f9eca85dc5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:10.979213 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fd0d1696-91ce-455a-b3da-c8f9eca85dc5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:10.982897 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4a0b3c60-2b95-47d1-a7c9-f70764fdd3f6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.983666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4a0b3c60-2b95-47d1-a7c9-f70764fdd3f6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.985055 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4a0b3c60-2b95-47d1-a7c9-f70764fdd3f6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.985249 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd0d1696-91ce-455a-b3da-c8f9eca85dc5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.985698 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd0d1696-91ce-455a-b3da-c8f9eca85dc5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.985851 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4a0b3c60-2b95-47d1-a7c9-f70764fdd3f6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.986500 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd0d1696-91ce-455a-b3da-c8f9eca85dc5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.986933 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd0d1696-91ce-455a-b3da-c8f9eca85dc5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.145801 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fd0d1696-91ce-455a-b3da-c8f9eca85dc5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.172709 Oct 28 08:43:11.146872 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 278/613] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:10 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:11.154222 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4a0b3c60-2b95-47d1-a7c9-f70764fdd3f6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.184727 Oct 28 08:43:11.155608 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 336/614] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:10 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:11.277730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3e0df887-9649-48ac-95b1-49fbdf9c28ad tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:11.278494 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3e0df887-9649-48ac-95b1-49fbdf9c28ad tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:11.286677 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e0df887-9649-48ac-95b1-49fbdf9c28ad tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.287124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e0df887-9649-48ac-95b1-49fbdf9c28ad tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.287907 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e0df887-9649-48ac-95b1-49fbdf9c28ad tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.288342 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e0df887-9649-48ac-95b1-49fbdf9c28ad tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.295431 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c48273bb-d24a-480d-9b7f-2cb00b8400a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:11.296161 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c48273bb-d24a-480d-9b7f-2cb00b8400a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:11.303728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c48273bb-d24a-480d-9b7f-2cb00b8400a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.304176 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c48273bb-d24a-480d-9b7f-2cb00b8400a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.305023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c48273bb-d24a-480d-9b7f-2cb00b8400a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.305455 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c48273bb-d24a-480d-9b7f-2cb00b8400a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.497643 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3e0df887-9649-48ac-95b1-49fbdf9c28ad tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:11.503926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c48273bb-d24a-480d-9b7f-2cb00b8400a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:11.506805 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3e0df887-9649-48ac-95b1-49fbdf9c28ad tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1554 microversion: 2.1 time: 0.233215 Oct 28 08:43:11.507387 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 279/615] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:11 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:11.512082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c48273bb-d24a-480d-9b7f-2cb00b8400a5 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.220650 Oct 28 08:43:11.512641 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 337/616] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:11 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:12.157837 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c7aa8fa8-debd-4e84-9f9f-6a4ae3f8894b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:12.158826 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c7aa8fa8-debd-4e84-9f9f-6a4ae3f8894b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:12.166473 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c7aa8fa8-debd-4e84-9f9f-6a4ae3f8894b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.166915 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c7aa8fa8-debd-4e84-9f9f-6a4ae3f8894b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.167076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-80576066-caea-47bf-ae31-28b4e4338687 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:12.167721 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c7aa8fa8-debd-4e84-9f9f-6a4ae3f8894b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.167984 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-80576066-caea-47bf-ae31-28b4e4338687 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:12.168156 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c7aa8fa8-debd-4e84-9f9f-6a4ae3f8894b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.174550 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80576066-caea-47bf-ae31-28b4e4338687 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.174993 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80576066-caea-47bf-ae31-28b4e4338687 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.175768 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80576066-caea-47bf-ae31-28b4e4338687 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.176199 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80576066-caea-47bf-ae31-28b4e4338687 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.252578 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c7aa8fa8-debd-4e84-9f9f-6a4ae3f8894b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.098191 Oct 28 08:43:12.253833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 280/617] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:12 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:12.256896 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-80576066-caea-47bf-ae31-28b4e4338687 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.093461 Oct 28 08:43:12.257913 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 338/618] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:12 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:12.526205 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6feb3c43-4022-44aa-80fb-907cd6de3990 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:12.526734 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6feb3c43-4022-44aa-80fb-907cd6de3990 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:12.528897 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d31fc1ff-a30a-496d-b2c7-de767c7658c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:12.529600 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d31fc1ff-a30a-496d-b2c7-de767c7658c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:12.534334 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6feb3c43-4022-44aa-80fb-907cd6de3990 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.535056 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6feb3c43-4022-44aa-80fb-907cd6de3990 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.535847 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6feb3c43-4022-44aa-80fb-907cd6de3990 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.536282 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6feb3c43-4022-44aa-80fb-907cd6de3990 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.537325 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d31fc1ff-a30a-496d-b2c7-de767c7658c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.537800 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d31fc1ff-a30a-496d-b2c7-de767c7658c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.538575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d31fc1ff-a30a-496d-b2c7-de767c7658c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.539214 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d31fc1ff-a30a-496d-b2c7-de767c7658c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.791638 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d31fc1ff-a30a-496d-b2c7-de767c7658c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:12.794409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6feb3c43-4022-44aa-80fb-907cd6de3990 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:12.815704 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d31fc1ff-a30a-496d-b2c7-de767c7658c9 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.290743 Oct 28 08:43:12.817146 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 339/619] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:12 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:12.818311 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6feb3c43-4022-44aa-80fb-907cd6de3990 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1560 microversion: 2.1 time: 0.296843 Oct 28 08:43:12.819479 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 281/620] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:12 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1560 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:12.904419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d72dd3f6-ad21-40ad-9b89-91c668225bab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:12.904954 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d72dd3f6-ad21-40ad-9b89-91c668225bab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:12.911023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d72dd3f6-ad21-40ad-9b89-91c668225bab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.911966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d72dd3f6-ad21-40ad-9b89-91c668225bab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.912749 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d72dd3f6-ad21-40ad-9b89-91c668225bab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.913172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d72dd3f6-ad21-40ad-9b89-91c668225bab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.983441 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-090da245-a2e9-4e3f-96d8-f3dbf8dcdb4a req-5aa7fb5b-1a05-4e9e-88e4-406847888d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b242f3a-0fab-4607-8a43-80c4d15255c6", "name": "network-vif-plugged", "status": "completed", "tag": "b5f4ba07-a5b6-40dc-b577-c707a79bc3d0"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:12.988393 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:12.988393 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:43:12.999035 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-090da245-a2e9-4e3f-96d8-f3dbf8dcdb4a req-5aa7fb5b-1a05-4e9e-88e4-406847888d56 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.999492 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-d72dd3f6-ad21-40ad-9b89-91c668225bab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lazy-loading 'services' on Instance uuid c70c146b-a5ed-43af-aad8-18fb35f2dab5 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:13.000076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-090da245-a2e9-4e3f-96d8-f3dbf8dcdb4a req-5aa7fb5b-1a05-4e9e-88e4-406847888d56 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.017624 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-090da245-a2e9-4e3f-96d8-f3dbf8dcdb4a req-5aa7fb5b-1a05-4e9e-88e4-406847888d56 service nova] Creating event network-vif-plugged:b5f4ba07-a5b6-40dc-b577-c707a79bc3d0 for instance 7b242f3a-0fab-4607-8a43-80c4d15255c6 on hv-cinder-81566 Oct 28 08:43:13.044998 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-090da245-a2e9-4e3f-96d8-f3dbf8dcdb4a req-5aa7fb5b-1a05-4e9e-88e4-406847888d56 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065339 Oct 28 08:43:13.050222 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 282/621] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:43:13.097501 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d72dd3f6-ad21-40ad-9b89-91c668225bab tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "DELETE /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments/1db700b7-6512-4a99-8ddb-a5eb8f5ad989" status: 202 len: 0 microversion: 2.1 time: 0.197155 Oct 28 08:43:13.102174 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 340/622] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:43:12 2021] DELETE /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments/1db700b7-6512-4a99-8ddb-a5eb8f5ad989 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:13.110109 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b5e52d9f-dbd7-4e38-af8b-4d659c9e4ea4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:13.111172 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b5e52d9f-dbd7-4e38-af8b-4d659c9e4ea4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:13.119454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5e52d9f-dbd7-4e38-af8b-4d659c9e4ea4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.120120 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5e52d9f-dbd7-4e38-af8b-4d659c9e4ea4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.121125 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5e52d9f-dbd7-4e38-af8b-4d659c9e4ea4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.121727 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5e52d9f-dbd7-4e38-af8b-4d659c9e4ea4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.163642 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b5e52d9f-dbd7-4e38-af8b-4d659c9e4ea4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059329 Oct 28 08:43:13.165445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 283/623] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:43:13 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:13.267881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-94ca94a0-3e59-48ad-9cd0-bb3d1cfbcb2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:13.268450 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5e83a903-6b0b-4a4c-bb73-9af6d0d8fcf9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:13.269371 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5e83a903-6b0b-4a4c-bb73-9af6d0d8fcf9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:13.270023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-94ca94a0-3e59-48ad-9cd0-bb3d1cfbcb2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:13.276425 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5e83a903-6b0b-4a4c-bb73-9af6d0d8fcf9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.276962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5e83a903-6b0b-4a4c-bb73-9af6d0d8fcf9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.277884 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5e83a903-6b0b-4a4c-bb73-9af6d0d8fcf9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.278398 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-94ca94a0-3e59-48ad-9cd0-bb3d1cfbcb2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.278526 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5e83a903-6b0b-4a4c-bb73-9af6d0d8fcf9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.279122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-94ca94a0-3e59-48ad-9cd0-bb3d1cfbcb2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.280112 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-94ca94a0-3e59-48ad-9cd0-bb3d1cfbcb2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.280741 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-94ca94a0-3e59-48ad-9cd0-bb3d1cfbcb2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.607301 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5e83a903-6b0b-4a4c-bb73-9af6d0d8fcf9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 28683 microversion: 2.1 time: 0.342309 Oct 28 08:43:13.609405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 284/624] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:13 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 28683 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:13.611263 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-94ca94a0-3e59-48ad-9cd0-bb3d1cfbcb2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.347786 Oct 28 08:43:13.615839 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 341/625] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:13 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:13.834957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-73bcf02b-925f-4e5a-ba46-ff3739509c9e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:13.835662 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-73bcf02b-925f-4e5a-ba46-ff3739509c9e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:13.846679 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-73bcf02b-925f-4e5a-ba46-ff3739509c9e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.847359 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-73bcf02b-925f-4e5a-ba46-ff3739509c9e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.848241 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-73bcf02b-925f-4e5a-ba46-ff3739509c9e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.849271 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-73bcf02b-925f-4e5a-ba46-ff3739509c9e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.002938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-73bcf02b-925f-4e5a-ba46-ff3739509c9e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:14.012455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-73bcf02b-925f-4e5a-ba46-ff3739509c9e tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.182400 Oct 28 08:43:14.013132 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 285/626] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:13 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:14.178290 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-eb3a4c89-19d8-44b7-9840-bdb480ad61fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:14.179362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-eb3a4c89-19d8-44b7-9840-bdb480ad61fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:14.187862 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb3a4c89-19d8-44b7-9840-bdb480ad61fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:14.188307 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb3a4c89-19d8-44b7-9840-bdb480ad61fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.189091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb3a4c89-19d8-44b7-9840-bdb480ad61fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:14.189595 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb3a4c89-19d8-44b7-9840-bdb480ad61fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.231829 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-eb3a4c89-19d8-44b7-9840-bdb480ad61fc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058481 Oct 28 08:43:14.236109 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 342/627] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:43:14 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:43:14.619887 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3f3d9958-9c65-49c3-b93d-1e9fb3030ac2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:14.621653 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3f3d9958-9c65-49c3-b93d-1e9fb3030ac2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:14.625568 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2281cea3-1d8d-4e2d-8f9e-ce92cbe5b0d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:14.627473 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2281cea3-1d8d-4e2d-8f9e-ce92cbe5b0d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:14.628886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f3d9958-9c65-49c3-b93d-1e9fb3030ac2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:14.629554 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f3d9958-9c65-49c3-b93d-1e9fb3030ac2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.631795 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f3d9958-9c65-49c3-b93d-1e9fb3030ac2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:14.632430 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f3d9958-9c65-49c3-b93d-1e9fb3030ac2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.636307 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2281cea3-1d8d-4e2d-8f9e-ce92cbe5b0d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:14.636863 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2281cea3-1d8d-4e2d-8f9e-ce92cbe5b0d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.637830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2281cea3-1d8d-4e2d-8f9e-ce92cbe5b0d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:14.638398 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2281cea3-1d8d-4e2d-8f9e-ce92cbe5b0d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.730758 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2281cea3-1d8d-4e2d-8f9e-ce92cbe5b0d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.109995 Oct 28 08:43:14.732322 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 343/628] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:14 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:14.757976 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3f3d9958-9c65-49c3-b93d-1e9fb3030ac2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 29209 microversion: 2.1 time: 0.141539 Oct 28 08:43:14.759046 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 286/629] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:14 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 29209 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:15.034738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5b51a6e0-7e3b-4757-a75c-246bcc9cf9e7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:15.035829 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5b51a6e0-7e3b-4757-a75c-246bcc9cf9e7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:15.050170 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5b51a6e0-7e3b-4757-a75c-246bcc9cf9e7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.051394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5b51a6e0-7e3b-4757-a75c-246bcc9cf9e7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.053167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5b51a6e0-7e3b-4757-a75c-246bcc9cf9e7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.053998 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5b51a6e0-7e3b-4757-a75c-246bcc9cf9e7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.245026 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6e89ea61-35fb-478b-8047-3c3939e76728 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:15.246152 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6e89ea61-35fb-478b-8047-3c3939e76728 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:15.253603 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e89ea61-35fb-478b-8047-3c3939e76728 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.254344 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e89ea61-35fb-478b-8047-3c3939e76728 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.256095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e89ea61-35fb-478b-8047-3c3939e76728 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.256564 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e89ea61-35fb-478b-8047-3c3939e76728 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.290096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6e89ea61-35fb-478b-8047-3c3939e76728 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049787 Oct 28 08:43:15.290876 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 287/630] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:43:15 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:43:15.296741 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5b51a6e0-7e3b-4757-a75c-246bcc9cf9e7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:15.309183 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5b51a6e0-7e3b-4757-a75c-246bcc9cf9e7 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1319 microversion: 2.1 time: 0.282319 Oct 28 08:43:15.320182 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 344/631] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:15 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:15.744542 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c1df1330-9ac8-43ad-b489-18c93f86e610 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:15.745653 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c1df1330-9ac8-43ad-b489-18c93f86e610 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:15.752176 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c1df1330-9ac8-43ad-b489-18c93f86e610 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.752619 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c1df1330-9ac8-43ad-b489-18c93f86e610 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.753416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c1df1330-9ac8-43ad-b489-18c93f86e610 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.753863 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c1df1330-9ac8-43ad-b489-18c93f86e610 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.769137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5f41aaa4-1153-424f-a3cc-33a9340ccd42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:15.770920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5f41aaa4-1153-424f-a3cc-33a9340ccd42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:15.787893 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5f41aaa4-1153-424f-a3cc-33a9340ccd42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.788533 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5f41aaa4-1153-424f-a3cc-33a9340ccd42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.789485 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5f41aaa4-1153-424f-a3cc-33a9340ccd42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.789974 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5f41aaa4-1153-424f-a3cc-33a9340ccd42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.832387 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c1df1330-9ac8-43ad-b489-18c93f86e610 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.091296 Oct 28 08:43:15.834107 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 288/632] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:15 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:15.902900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5f41aaa4-1153-424f-a3cc-33a9340ccd42 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 30547 microversion: 2.1 time: 0.137216 Oct 28 08:43:15.903678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 345/633] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:15 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 30547 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:16.327832 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-de9bdb7e-2d9f-49cd-91b8-f4f7959be84a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:16.328533 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-de9bdb7e-2d9f-49cd-91b8-f4f7959be84a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:16.336819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de9bdb7e-2d9f-49cd-91b8-f4f7959be84a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.337371 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de9bdb7e-2d9f-49cd-91b8-f4f7959be84a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.338262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de9bdb7e-2d9f-49cd-91b8-f4f7959be84a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.338774 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de9bdb7e-2d9f-49cd-91b8-f4f7959be84a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.772068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-de9bdb7e-2d9f-49cd-91b8-f4f7959be84a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:16.787560 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-de9bdb7e-2d9f-49cd-91b8-f4f7959be84a tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1507 microversion: 2.1 time: 0.462540 Oct 28 08:43:16.788718 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 289/634] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:16 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:16.807110 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d2930cc2-59f9-4bfb-abeb-a8800d18ef65 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74fe9774-d172-4ad2-aa3a-9299fd293d70", "device": "/dev/sdb"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:16.809265 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d2930cc2-59f9-4bfb-abeb-a8800d18ef65 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:16.816954 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d2930cc2-59f9-4bfb-abeb-a8800d18ef65 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.817907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d2930cc2-59f9-4bfb-abeb-a8800d18ef65 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.819241 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d2930cc2-59f9-4bfb-abeb-a8800d18ef65 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.819818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d2930cc2-59f9-4bfb-abeb-a8800d18ef65 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.853815 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e72183f5-279c-4b41-a1e5-8c20b48f51bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:16.855109 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e72183f5-279c-4b41-a1e5-8c20b48f51bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:16.863616 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e72183f5-279c-4b41-a1e5-8c20b48f51bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.864753 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e72183f5-279c-4b41-a1e5-8c20b48f51bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.865806 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e72183f5-279c-4b41-a1e5-8c20b48f51bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.866476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e72183f5-279c-4b41-a1e5-8c20b48f51bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.946266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e72183f5-279c-4b41-a1e5-8c20b48f51bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.098363 Oct 28 08:43:16.947615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 290/635] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:16 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:16.954090 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-90c068f6-1001-460b-99d6-3d35710f5d83 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:16.955452 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-90c068f6-1001-460b-99d6-3d35710f5d83 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:16.971115 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-90c068f6-1001-460b-99d6-3d35710f5d83 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.971930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-90c068f6-1001-460b-99d6-3d35710f5d83 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.972964 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-90c068f6-1001-460b-99d6-3d35710f5d83 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.974339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-90c068f6-1001-460b-99d6-3d35710f5d83 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.086032 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-90c068f6-1001-460b-99d6-3d35710f5d83 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 32166 microversion: 2.1 time: 0.135615 Oct 28 08:43:17.086989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 291/636] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:16 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 32166 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:17.156832 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d2930cc2-59f9-4bfb-abeb-a8800d18ef65 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "POST /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355107 Oct 28 08:43:17.163498 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 346/637] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:43:16 2021] POST /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:43:17.695138 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-da2cb6f3-e0cc-480d-bcb0-8e86fc57552f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:17.695728 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-da2cb6f3-e0cc-480d-bcb0-8e86fc57552f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:17.702902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-da2cb6f3-e0cc-480d-bcb0-8e86fc57552f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.703348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-da2cb6f3-e0cc-480d-bcb0-8e86fc57552f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.704281 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-da2cb6f3-e0cc-480d-bcb0-8e86fc57552f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.711889 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-da2cb6f3-e0cc-480d-bcb0-8e86fc57552f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.733593 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-da2cb6f3-e0cc-480d-bcb0-8e86fc57552f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:43:17.835886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-da2cb6f3-e0cc-480d-bcb0-8e86fc57552f tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 204 len: 0 microversion: 2.1 time: 0.144847 Oct 28 08:43:17.838540 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 292/638] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:43:17 2021] DELETE /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:43:17.847481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2040a4cb-e3dc-444e-8cc3-d2cc99dbe82e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:17.848509 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2040a4cb-e3dc-444e-8cc3-d2cc99dbe82e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:17.855782 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2040a4cb-e3dc-444e-8cc3-d2cc99dbe82e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.856718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2040a4cb-e3dc-444e-8cc3-d2cc99dbe82e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.857917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2040a4cb-e3dc-444e-8cc3-d2cc99dbe82e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.858722 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2040a4cb-e3dc-444e-8cc3-d2cc99dbe82e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.963621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-192781b1-17d2-404f-8089-d2eba9ed5321 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:17.965256 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-192781b1-17d2-404f-8089-d2eba9ed5321 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:17.972481 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-192781b1-17d2-404f-8089-d2eba9ed5321 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.973023 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-192781b1-17d2-404f-8089-d2eba9ed5321 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.978835 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-192781b1-17d2-404f-8089-d2eba9ed5321 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.979421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-192781b1-17d2-404f-8089-d2eba9ed5321 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:18.075502 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-192781b1-17d2-404f-8089-d2eba9ed5321 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.121165 Oct 28 08:43:18.083390 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 293/639] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:17 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:18.102686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-403e18b0-8a68-4817-b14b-f58407f5a212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:18.104880 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-403e18b0-8a68-4817-b14b-f58407f5a212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:18.116399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-403e18b0-8a68-4817-b14b-f58407f5a212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:18.117014 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-403e18b0-8a68-4817-b14b-f58407f5a212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:18.118528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-403e18b0-8a68-4817-b14b-f58407f5a212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:18.119129 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-403e18b0-8a68-4817-b14b-f58407f5a212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:18.128924 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2040a4cb-e3dc-444e-8cc3-d2cc99dbe82e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:18.137046 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2040a4cb-e3dc-444e-8cc3-d2cc99dbe82e tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1504 microversion: 2.1 time: 0.294415 Oct 28 08:43:18.139606 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 347/640] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:17 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:18.237968 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-403e18b0-8a68-4817-b14b-f58407f5a212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 33343 microversion: 2.1 time: 0.142978 Oct 28 08:43:18.242764 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 294/641] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:18 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 33343 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:19.089947 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-45b4826c-a541-4dce-aa0f-92292dc3be2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:19.090925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-45b4826c-a541-4dce-aa0f-92292dc3be2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:19.098012 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-45b4826c-a541-4dce-aa0f-92292dc3be2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.098540 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-45b4826c-a541-4dce-aa0f-92292dc3be2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.099270 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-45b4826c-a541-4dce-aa0f-92292dc3be2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.099723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-45b4826c-a541-4dce-aa0f-92292dc3be2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.155797 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a4926cea-5ecf-4bae-bade-999fb6c87454 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:19.156483 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a4926cea-5ecf-4bae-bade-999fb6c87454 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:19.164902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4926cea-5ecf-4bae-bade-999fb6c87454 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.165341 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4926cea-5ecf-4bae-bade-999fb6c87454 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.166149 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4926cea-5ecf-4bae-bade-999fb6c87454 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.166585 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4926cea-5ecf-4bae-bade-999fb6c87454 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.183815 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-45b4826c-a541-4dce-aa0f-92292dc3be2c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.097653 Oct 28 08:43:19.184464 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 348/642] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:19 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:19.251458 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3665ec1f-e329-4966-be9b-eba34312d613 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:19.252727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3665ec1f-e329-4966-be9b-eba34312d613 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:19.260240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3665ec1f-e329-4966-be9b-eba34312d613 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.260691 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3665ec1f-e329-4966-be9b-eba34312d613 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.261464 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3665ec1f-e329-4966-be9b-eba34312d613 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.262305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3665ec1f-e329-4966-be9b-eba34312d613 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.311173 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a4926cea-5ecf-4bae-bade-999fb6c87454 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:19.325916 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a4926cea-5ecf-4bae-bade-999fb6c87454 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1504 microversion: 2.1 time: 0.173980 Oct 28 08:43:19.326495 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 295/643] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:19 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:19.381486 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3665ec1f-e329-4966-be9b-eba34312d613 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 34047 microversion: 2.1 time: 0.133277 Oct 28 08:43:19.382208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 349/644] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:19 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 34047 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:20.197992 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f575ffdc-76ac-434e-8420-e45d0aa2390b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:20.199195 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f575ffdc-76ac-434e-8420-e45d0aa2390b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:20.207631 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f575ffdc-76ac-434e-8420-e45d0aa2390b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.209654 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f575ffdc-76ac-434e-8420-e45d0aa2390b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.210647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f575ffdc-76ac-434e-8420-e45d0aa2390b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.211187 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f575ffdc-76ac-434e-8420-e45d0aa2390b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.279371 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f575ffdc-76ac-434e-8420-e45d0aa2390b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28167 microversion: 2.20 time: 0.087154 Oct 28 08:43:20.283326 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 296/645] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:20 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28167 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:20.344857 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-320fc313-4cad-4f3c-9b57-8af4fc4ddb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:20.345562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-320fc313-4cad-4f3c-9b57-8af4fc4ddb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:20.353447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-320fc313-4cad-4f3c-9b57-8af4fc4ddb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.353927 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-320fc313-4cad-4f3c-9b57-8af4fc4ddb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.355085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-320fc313-4cad-4f3c-9b57-8af4fc4ddb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.355704 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-320fc313-4cad-4f3c-9b57-8af4fc4ddb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.396324 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7397cfcb-02d5-4dcc-9087-a1f47ef10058 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:20.397365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7397cfcb-02d5-4dcc-9087-a1f47ef10058 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:20.423630 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7397cfcb-02d5-4dcc-9087-a1f47ef10058 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.424376 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7397cfcb-02d5-4dcc-9087-a1f47ef10058 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.425325 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7397cfcb-02d5-4dcc-9087-a1f47ef10058 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.425758 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7397cfcb-02d5-4dcc-9087-a1f47ef10058 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.546641 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-320fc313-4cad-4f3c-9b57-8af4fc4ddb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:20.555561 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-320fc313-4cad-4f3c-9b57-8af4fc4ddb5d tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1504 microversion: 2.1 time: 0.215018 Oct 28 08:43:20.557365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 350/646] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:20 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:20.611730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7397cfcb-02d5-4dcc-9087-a1f47ef10058 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 35155 microversion: 2.1 time: 0.221222 Oct 28 08:43:20.612382 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 297/647] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:20 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 35155 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:21.291245 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3993ec90-616b-490c-b9ca-10003f925008 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:21.292169 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3993ec90-616b-490c-b9ca-10003f925008 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:21.298249 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3993ec90-616b-490c-b9ca-10003f925008 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:21.298888 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3993ec90-616b-490c-b9ca-10003f925008 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:21.299822 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3993ec90-616b-490c-b9ca-10003f925008 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:21.300255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3993ec90-616b-490c-b9ca-10003f925008 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:21.387801 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3993ec90-616b-490c-b9ca-10003f925008 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28362 microversion: 2.20 time: 0.100000 Oct 28 08:43:21.391103 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 351/648] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:21 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28362 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:21.578351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3d818de0-6fd7-4fbc-84f7-a8145fc54ab6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:21.580738 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3d818de0-6fd7-4fbc-84f7-a8145fc54ab6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:21.594662 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3d818de0-6fd7-4fbc-84f7-a8145fc54ab6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:21.595160 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3d818de0-6fd7-4fbc-84f7-a8145fc54ab6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:21.595995 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3d818de0-6fd7-4fbc-84f7-a8145fc54ab6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:21.596457 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3d818de0-6fd7-4fbc-84f7-a8145fc54ab6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:21.640236 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4275fb3f-67e3-4e15-a592-8bd261695ad2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:21.642334 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4275fb3f-67e3-4e15-a592-8bd261695ad2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:21.667479 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4275fb3f-67e3-4e15-a592-8bd261695ad2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:21.669824 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4275fb3f-67e3-4e15-a592-8bd261695ad2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:21.672127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4275fb3f-67e3-4e15-a592-8bd261695ad2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:21.673529 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4275fb3f-67e3-4e15-a592-8bd261695ad2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:21.824634 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4275fb3f-67e3-4e15-a592-8bd261695ad2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 36182 microversion: 2.1 time: 0.193552 Oct 28 08:43:21.826013 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 352/649] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:21 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 36182 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:21.853213 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3d818de0-6fd7-4fbc-84f7-a8145fc54ab6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:21.877080 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3d818de0-6fd7-4fbc-84f7-a8145fc54ab6 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1504 microversion: 2.1 time: 0.301833 Oct 28 08:43:21.877959 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 298/650] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:21 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:22.403535 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a05bd79f-056d-4e40-96db-b191f7d789d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:22.406144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a05bd79f-056d-4e40-96db-b191f7d789d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:22.415168 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a05bd79f-056d-4e40-96db-b191f7d789d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.415742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a05bd79f-056d-4e40-96db-b191f7d789d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.416658 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a05bd79f-056d-4e40-96db-b191f7d789d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.417206 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a05bd79f-056d-4e40-96db-b191f7d789d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.479759 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-3c747ab2-2d0a-43a8-8739-b7a8010dd9f2 req-f4926425-a4f3-4a84-9f8b-fa85779f494a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f8fde60-8e1e-4fdd-93bb-2731aaa3b816", "name": "network-vif-deleted", "tag": "21f88ffd-b1f0-4eee-a795-5feb6bbbdd08"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:22.492715 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:22.492715 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:43:22.507598 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-3c747ab2-2d0a-43a8-8739-b7a8010dd9f2 req-f4926425-a4f3-4a84-9f8b-fa85779f494a service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.510643 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-3c747ab2-2d0a-43a8-8739-b7a8010dd9f2 req-f4926425-a4f3-4a84-9f8b-fa85779f494a service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.515148 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a05bd79f-056d-4e40-96db-b191f7d789d4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28458 microversion: 2.20 time: 0.115670 Oct 28 08:43:22.516559 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 353/651] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:22 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28458 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:22.540774 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-3c747ab2-2d0a-43a8-8739-b7a8010dd9f2 req-f4926425-a4f3-4a84-9f8b-fa85779f494a service nova] Creating event network-vif-deleted:21f88ffd-b1f0-4eee-a795-5feb6bbbdd08 for instance 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 on hv-cinder-81566 Oct 28 08:43:22.553094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-3c747ab2-2d0a-43a8-8739-b7a8010dd9f2 req-f4926425-a4f3-4a84-9f8b-fa85779f494a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078075 Oct 28 08:43:22.558949 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 299/652] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:43:22.840327 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-10bb2d1b-8f58-4f70-9c4c-bb5078a98277 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:22.841512 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-10bb2d1b-8f58-4f70-9c4c-bb5078a98277 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:22.850932 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10bb2d1b-8f58-4f70-9c4c-bb5078a98277 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.851470 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10bb2d1b-8f58-4f70-9c4c-bb5078a98277 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.852327 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10bb2d1b-8f58-4f70-9c4c-bb5078a98277 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.852830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-10bb2d1b-8f58-4f70-9c4c-bb5078a98277 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.898669 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:22.900114 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:22.912029 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.912901 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.914143 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.914829 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.954167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-10bb2d1b-8f58-4f70-9c4c-bb5078a98277 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 37510 microversion: 2.1 time: 0.118221 Oct 28 08:43:22.955280 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 354/653] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:22 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 37510 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:22.961339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.962842 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.963455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.objects.instance [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lazy-loading 'fault' on Instance uuid 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 {{(pid=132796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:23.019454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:23.036439 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b3d29209-3c2c-468e-9db9-c8a9c120e4db tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 200 len: 1309 microversion: 2.1 time: 0.144757 Oct 28 08:43:23.038239 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 300/654] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:22 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 1309 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:23.528559 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-02eec08a-7379-471d-9e72-8fc1489f4d4e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:23.530209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-02eec08a-7379-471d-9e72-8fc1489f4d4e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:23.551436 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-02eec08a-7379-471d-9e72-8fc1489f4d4e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.552028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-02eec08a-7379-471d-9e72-8fc1489f4d4e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.552703 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-02eec08a-7379-471d-9e72-8fc1489f4d4e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.561848 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-02eec08a-7379-471d-9e72-8fc1489f4d4e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.726046 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-02eec08a-7379-471d-9e72-8fc1489f4d4e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28493 microversion: 2.20 time: 0.201149 Oct 28 08:43:23.726723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 355/655] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:23 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28493 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:23.975095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-02a564b5-ee24-4295-b249-5bb0a70eb991 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:23.976767 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-02a564b5-ee24-4295-b249-5bb0a70eb991 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:23.992531 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-02a564b5-ee24-4295-b249-5bb0a70eb991 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.998569 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-02a564b5-ee24-4295-b249-5bb0a70eb991 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.000931 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-02a564b5-ee24-4295-b249-5bb0a70eb991 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.007324 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-02a564b5-ee24-4295-b249-5bb0a70eb991 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.069627 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6b93fb0a-c889-4d8a-88b4-6954ea9e9aec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:24.070428 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6b93fb0a-c889-4d8a-88b4-6954ea9e9aec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:24.099141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6b93fb0a-c889-4d8a-88b4-6954ea9e9aec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.107607 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6b93fb0a-c889-4d8a-88b4-6954ea9e9aec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.110738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6b93fb0a-c889-4d8a-88b4-6954ea9e9aec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.111189 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6b93fb0a-c889-4d8a-88b4-6954ea9e9aec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.142977 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-6b93fb0a-c889-4d8a-88b4-6954ea9e9aec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] HTTP exception thrown: Instance 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 could not be found. Oct 28 08:43:24.143561 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6b93fb0a-c889-4d8a-88b4-6954ea9e9aec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Returning 404 to user: Instance 1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:43:24.144511 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6b93fb0a-c889-4d8a-88b4-6954ea9e9aec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816" status: 404 len: 111 microversion: 2.1 time: 0.089741 Oct 28 08:43:24.144750 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-02a564b5-ee24-4295-b249-5bb0a70eb991 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 38210 microversion: 2.1 time: 0.179801 Oct 28 08:43:24.145087 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 356/656] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:24 2021] GET /compute/v2.1/servers/1f8fde60-8e1e-4fdd-93bb-2731aaa3b816 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:43:24.150083 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 301/657] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:23 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 38210 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:24.187596 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2256477d-ffb3-4ccd-af69-aa9338e5f043 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:24.191471 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2256477d-ffb3-4ccd-af69-aa9338e5f043 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:24.209713 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2256477d-ffb3-4ccd-af69-aa9338e5f043 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.219491 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2256477d-ffb3-4ccd-af69-aa9338e5f043 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.220332 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2256477d-ffb3-4ccd-af69-aa9338e5f043 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.220764 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2256477d-ffb3-4ccd-af69-aa9338e5f043 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.314923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2256477d-ffb3-4ccd-af69-aa9338e5f043 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Going to try to terminate instance {{(pid=132797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:43:24.539923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2256477d-ffb3-4ccd-af69-aa9338e5f043 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "DELETE /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 204 len: 0 microversion: 2.1 time: 0.374177 Oct 28 08:43:24.540586 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 357/658] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:43:24 2021] DELETE /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:43:24.550065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ae16544b-6d31-46b4-8906-464e51269ff4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:24.550932 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ae16544b-6d31-46b4-8906-464e51269ff4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:24.560522 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae16544b-6d31-46b4-8906-464e51269ff4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.561114 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae16544b-6d31-46b4-8906-464e51269ff4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.562059 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae16544b-6d31-46b4-8906-464e51269ff4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.563411 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae16544b-6d31-46b4-8906-464e51269ff4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.739926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-48b67e06-6cc1-4ea1-b78d-4265c87834ec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:24.740933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-48b67e06-6cc1-4ea1-b78d-4265c87834ec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:24.759228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48b67e06-6cc1-4ea1-b78d-4265c87834ec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.760266 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48b67e06-6cc1-4ea1-b78d-4265c87834ec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.761306 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48b67e06-6cc1-4ea1-b78d-4265c87834ec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.762003 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48b67e06-6cc1-4ea1-b78d-4265c87834ec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.880882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-48b67e06-6cc1-4ea1-b78d-4265c87834ec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.145485 Oct 28 08:43:24.881656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 358/659] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:24 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:25.158826 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-767ad323-216a-4b63-adf9-b68d7d8c44ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:25.159984 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-767ad323-216a-4b63-adf9-b68d7d8c44ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:25.167511 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-767ad323-216a-4b63-adf9-b68d7d8c44ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.167930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-767ad323-216a-4b63-adf9-b68d7d8c44ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.168697 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-767ad323-216a-4b63-adf9-b68d7d8c44ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.169381 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-767ad323-216a-4b63-adf9-b68d7d8c44ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.202179 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ae16544b-6d31-46b4-8906-464e51269ff4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:25.213555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ae16544b-6d31-46b4-8906-464e51269ff4 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.668321 Oct 28 08:43:25.214190 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 302/660] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:24 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:25.263092 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-767ad323-216a-4b63-adf9-b68d7d8c44ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 38210 microversion: 2.1 time: 0.108823 Oct 28 08:43:25.264023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 359/661] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:25 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 38210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:25.849691 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f8331392-6b61-4104-8e32-be35111bcc07 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Action: 'create', calling method: .version_select at 0x7f9e781645e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-21201921"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:25.868340 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-f8331392-6b61-4104-8e32-be35111bcc07 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Getting quotas for project 3f8be4e851fc4c5bb989b23068ab50b0. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:43:25.872133 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-f8331392-6b61-4104-8e32-be35111bcc07 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Getting quotas for user c731f20a04204d9ea0b04a20f2e72577 and project 3f8be4e851fc4c5bb989b23068ab50b0. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:43:25.894120 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c96a7836-397a-429a-92c5-1dee1615b930 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:25.895039 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c96a7836-397a-429a-92c5-1dee1615b930 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:25.903230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c96a7836-397a-429a-92c5-1dee1615b930 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.903683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c96a7836-397a-429a-92c5-1dee1615b930 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.904467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c96a7836-397a-429a-92c5-1dee1615b930 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.905045 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c96a7836-397a-429a-92c5-1dee1615b930 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.041653 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-f8331392-6b61-4104-8e32-be35111bcc07 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Getting quotas for project 3f8be4e851fc4c5bb989b23068ab50b0. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:43:26.046233 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-f8331392-6b61-4104-8e32-be35111bcc07 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Getting quotas for user c731f20a04204d9ea0b04a20f2e72577 and project 3f8be4e851fc4c5bb989b23068ab50b0. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:43:26.061339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f8331392-6b61-4104-8e32-be35111bcc07 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.407723 Oct 28 08:43:26.067555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 303/662] 10.222.0.74 () {60 vars in 1157 bytes} [Thu Oct 28 08:43:25 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:26.231731 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b7ca7302-7021-4ebc-8c89-d5c5088914d1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:26.235401 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b7ca7302-7021-4ebc-8c89-d5c5088914d1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:26.240057 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b7ca7302-7021-4ebc-8c89-d5c5088914d1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.240540 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b7ca7302-7021-4ebc-8c89-d5c5088914d1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.241669 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b7ca7302-7021-4ebc-8c89-d5c5088914d1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.242087 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b7ca7302-7021-4ebc-8c89-d5c5088914d1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.404723 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b7ca7302-7021-4ebc-8c89-d5c5088914d1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:26.423759 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b7ca7302-7021-4ebc-8c89-d5c5088914d1 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.195682 Oct 28 08:43:26.425046 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 304/663] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:26 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:26.436453 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f726773d-cf00-4c46-a98c-43f13cb824e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:26.438525 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f726773d-cf00-4c46-a98c-43f13cb824e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:26.445968 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f726773d-cf00-4c46-a98c-43f13cb824e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.446793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f726773d-cf00-4c46-a98c-43f13cb824e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.447845 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f726773d-cf00-4c46-a98c-43f13cb824e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.448285 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f726773d-cf00-4c46-a98c-43f13cb824e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:29.972555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f726773d-cf00-4c46-a98c-43f13cb824e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 38210 microversion: 2.1 time: 3.545683 Oct 28 08:43:29.974523 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 305/664] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:26 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 38210 bytes in 3548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:29.980769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-54c4e622-13a0-4f47-819f-9c32f112c4ec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:29.981052 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c96a7836-397a-429a-92c5-1dee1615b930 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 4.090729 Oct 28 08:43:29.981637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-54c4e622-13a0-4f47-819f-9c32f112c4ec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:29.984839 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 360/665] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:25 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 4093 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:29.988042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54c4e622-13a0-4f47-819f-9c32f112c4ec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:29.988546 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54c4e622-13a0-4f47-819f-9c32f112c4ec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:29.990261 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54c4e622-13a0-4f47-819f-9c32f112c4ec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:29.990686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-54c4e622-13a0-4f47-819f-9c32f112c4ec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.153444 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-54c4e622-13a0-4f47-819f-9c32f112c4ec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:30.161136 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-54c4e622-13a0-4f47-819f-9c32f112c4ec tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.185330 Oct 28 08:43:30.161824 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 306/666] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:29 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:30.987816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c690073f-a27d-4a06-99df-21c7b0653f8d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:30.990641 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c690073f-a27d-4a06-99df-21c7b0653f8d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:30.993196 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3f70e506-f91c-4c9d-bad8-e388d131a6cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:30.994149 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3f70e506-f91c-4c9d-bad8-e388d131a6cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:30.997708 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c690073f-a27d-4a06-99df-21c7b0653f8d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.998199 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c690073f-a27d-4a06-99df-21c7b0653f8d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.998975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c690073f-a27d-4a06-99df-21c7b0653f8d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.999400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c690073f-a27d-4a06-99df-21c7b0653f8d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:31.000645 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f70e506-f91c-4c9d-bad8-e388d131a6cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:31.001103 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f70e506-f91c-4c9d-bad8-e388d131a6cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:31.001901 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f70e506-f91c-4c9d-bad8-e388d131a6cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:31.002392 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f70e506-f91c-4c9d-bad8-e388d131a6cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:31.081353 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3f70e506-f91c-4c9d-bad8-e388d131a6cd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.092223 Oct 28 08:43:31.082162 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 307/667] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:30 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:31.087755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c690073f-a27d-4a06-99df-21c7b0653f8d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 38210 microversion: 2.1 time: 0.104769 Oct 28 08:43:31.090057 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 361/668] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:30 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 38210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:31.179487 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a6b6e304-d56b-4404-9abd-6c4ec9cf8297 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:31.180202 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a6b6e304-d56b-4404-9abd-6c4ec9cf8297 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:31.188057 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6b6e304-d56b-4404-9abd-6c4ec9cf8297 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:31.188465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6b6e304-d56b-4404-9abd-6c4ec9cf8297 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:31.189244 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6b6e304-d56b-4404-9abd-6c4ec9cf8297 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:31.189701 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6b6e304-d56b-4404-9abd-6c4ec9cf8297 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:31.323811 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a6b6e304-d56b-4404-9abd-6c4ec9cf8297 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:31.332205 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a6b6e304-d56b-4404-9abd-6c4ec9cf8297 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.157153 Oct 28 08:43:31.332788 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 308/669] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:31 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:32.093263 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-be4b8118-33d3-4c1f-8088-639f55aa31fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:32.094211 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-be4b8118-33d3-4c1f-8088-639f55aa31fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:32.099335 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-76d74c6e-30d4-4c55-8d85-b546c69182ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:32.100247 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-76d74c6e-30d4-4c55-8d85-b546c69182ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:32.101472 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be4b8118-33d3-4c1f-8088-639f55aa31fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.101989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be4b8118-33d3-4c1f-8088-639f55aa31fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.102773 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be4b8118-33d3-4c1f-8088-639f55aa31fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.103204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be4b8118-33d3-4c1f-8088-639f55aa31fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.106303 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-76d74c6e-30d4-4c55-8d85-b546c69182ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.106753 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-76d74c6e-30d4-4c55-8d85-b546c69182ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.107522 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-76d74c6e-30d4-4c55-8d85-b546c69182ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.107950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-76d74c6e-30d4-4c55-8d85-b546c69182ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.175317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-be4b8118-33d3-4c1f-8088-639f55aa31fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.086098 Oct 28 08:43:32.175971 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 362/670] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:32 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:32.205493 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-76d74c6e-30d4-4c55-8d85-b546c69182ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 38226 microversion: 2.1 time: 0.109622 Oct 28 08:43:32.206197 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 309/671] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:32 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 38226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:32.350997 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-28727bd9-94e4-47de-9c13-9e388ceeb972 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:32.351601 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-28727bd9-94e4-47de-9c13-9e388ceeb972 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:32.358526 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28727bd9-94e4-47de-9c13-9e388ceeb972 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.358967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28727bd9-94e4-47de-9c13-9e388ceeb972 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.359729 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28727bd9-94e4-47de-9c13-9e388ceeb972 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.360163 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28727bd9-94e4-47de-9c13-9e388ceeb972 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.500348 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-28727bd9-94e4-47de-9c13-9e388ceeb972 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:32.508478 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-28727bd9-94e4-47de-9c13-9e388ceeb972 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.161661 Oct 28 08:43:32.509036 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 363/672] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:32 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:33.188182 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d05ad16d-946a-408e-9e5e-3221a4e390e3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:33.189124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d05ad16d-946a-408e-9e5e-3221a4e390e3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:33.198154 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d05ad16d-946a-408e-9e5e-3221a4e390e3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:33.198597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d05ad16d-946a-408e-9e5e-3221a4e390e3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:33.199364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d05ad16d-946a-408e-9e5e-3221a4e390e3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:33.199792 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d05ad16d-946a-408e-9e5e-3221a4e390e3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:33.219454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f568a84e-0b88-4b70-8b42-f496e49f1c8b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:33.221219 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f568a84e-0b88-4b70-8b42-f496e49f1c8b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:33.230411 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f568a84e-0b88-4b70-8b42-f496e49f1c8b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:33.230941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f568a84e-0b88-4b70-8b42-f496e49f1c8b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:33.231831 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f568a84e-0b88-4b70-8b42-f496e49f1c8b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:33.232266 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f568a84e-0b88-4b70-8b42-f496e49f1c8b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:40.575529 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d05ad16d-946a-408e-9e5e-3221a4e390e3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 7.390631 Oct 28 08:43:40.576421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 310/673] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:33 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 7393 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:40.584046 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-96e196f0-d1f2-4c9b-9191-f40654f88a88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:40.584752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-96e196f0-d1f2-4c9b-9191-f40654f88a88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:40.591678 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-96e196f0-d1f2-4c9b-9191-f40654f88a88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:40.592124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-96e196f0-d1f2-4c9b-9191-f40654f88a88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:40.592902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-96e196f0-d1f2-4c9b-9191-f40654f88a88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:40.593337 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-96e196f0-d1f2-4c9b-9191-f40654f88a88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:40.602698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f568a84e-0b88-4b70-8b42-f496e49f1c8b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 200 len: 38339 microversion: 2.1 time: 7.389164 Oct 28 08:43:40.608242 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 364/674] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:33 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 38339 bytes in 7391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:40.613707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6882e73f-cac0-449b-8ecf-fce0e120f5da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:40.614423 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6882e73f-cac0-449b-8ecf-fce0e120f5da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:40.623454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6882e73f-cac0-449b-8ecf-fce0e120f5da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:40.623893 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6882e73f-cac0-449b-8ecf-fce0e120f5da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:40.624860 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6882e73f-cac0-449b-8ecf-fce0e120f5da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:40.625293 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6882e73f-cac0-449b-8ecf-fce0e120f5da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:40.650808 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6882e73f-cac0-449b-8ecf-fce0e120f5da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/ips" status: 200 len: 145 microversion: 2.1 time: 0.041038 Oct 28 08:43:40.651734 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 365/675] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Oct 28 08:43:40 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:40.740511 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-96e196f0-d1f2-4c9b-9191-f40654f88a88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:40.749723 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-96e196f0-d1f2-4c9b-9191-f40654f88a88 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.171613 Oct 28 08:43:40.750341 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 311/676] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:40 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:41.589524 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2a98bed7-62aa-4df2-a005-8386c329d44e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:41.590466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2a98bed7-62aa-4df2-a005-8386c329d44e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:41.596701 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2a98bed7-62aa-4df2-a005-8386c329d44e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.597137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2a98bed7-62aa-4df2-a005-8386c329d44e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.597917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2a98bed7-62aa-4df2-a005-8386c329d44e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.598342 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2a98bed7-62aa-4df2-a005-8386c329d44e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.700382 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2a98bed7-62aa-4df2-a005-8386c329d44e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.115160 Oct 28 08:43:41.701718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 366/677] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:41 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:41.766912 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-24c7a3ad-40f1-4a5a-b409-ce74475be0dc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:41.767560 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-24c7a3ad-40f1-4a5a-b409-ce74475be0dc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:41.775186 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-24c7a3ad-40f1-4a5a-b409-ce74475be0dc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.775631 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-24c7a3ad-40f1-4a5a-b409-ce74475be0dc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.776413 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-24c7a3ad-40f1-4a5a-b409-ce74475be0dc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.776877 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-24c7a3ad-40f1-4a5a-b409-ce74475be0dc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.907155 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-24c7a3ad-40f1-4a5a-b409-ce74475be0dc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:41.916104 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-24c7a3ad-40f1-4a5a-b409-ce74475be0dc tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.152936 Oct 28 08:43:41.916665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 312/678] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:41 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:42.713176 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-36c170f2-0cdd-4ff2-a055-ee9081e7a9ce tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:42.714589 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-36c170f2-0cdd-4ff2-a055-ee9081e7a9ce tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:42.721456 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36c170f2-0cdd-4ff2-a055-ee9081e7a9ce tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.721935 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36c170f2-0cdd-4ff2-a055-ee9081e7a9ce tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.722712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36c170f2-0cdd-4ff2-a055-ee9081e7a9ce tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.723146 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36c170f2-0cdd-4ff2-a055-ee9081e7a9ce tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.805869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-36c170f2-0cdd-4ff2-a055-ee9081e7a9ce tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.096833 Oct 28 08:43:42.809534 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 367/679] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:42 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:42.934269 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7839284b-1844-45f6-acbc-735e8e1bf7a9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:42.935528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7839284b-1844-45f6-acbc-735e8e1bf7a9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:42.943300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7839284b-1844-45f6-acbc-735e8e1bf7a9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.944131 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7839284b-1844-45f6-acbc-735e8e1bf7a9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.945479 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7839284b-1844-45f6-acbc-735e8e1bf7a9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.946107 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7839284b-1844-45f6-acbc-735e8e1bf7a9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.114274 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7839284b-1844-45f6-acbc-735e8e1bf7a9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e3067a6734b72acaea745888b8c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e86d34d96c64ad4a33efd5f4918dc05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:43.126893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7839284b-1844-45f6-acbc-735e8e1bf7a9 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 200 len: 1520 microversion: 2.1 time: 0.196258 Oct 28 08:43:43.127484 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 313/680] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:42 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:43.296674 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-0b37e30a-b4e6-41fe-90fe-aa0ede85b23d req-6e4179c1-379d-4fa2-8c08-180c123e165a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70c146b-a5ed-43af-aad8-18fb35f2dab5", "name": "network-vif-deleted", "tag": "93c85b10-5891-4f31-b058-20a4f4a01304"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:43.298330 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:43.298330 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:43:43.306465 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-0b37e30a-b4e6-41fe-90fe-aa0ede85b23d req-6e4179c1-379d-4fa2-8c08-180c123e165a service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.307233 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-0b37e30a-b4e6-41fe-90fe-aa0ede85b23d req-6e4179c1-379d-4fa2-8c08-180c123e165a service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.319214 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-0b37e30a-b4e6-41fe-90fe-aa0ede85b23d req-6e4179c1-379d-4fa2-8c08-180c123e165a service nova] Creating event network-vif-deleted:93c85b10-5891-4f31-b058-20a4f4a01304 for instance c70c146b-a5ed-43af-aad8-18fb35f2dab5 on hv-cinder-81566 Oct 28 08:43:43.325421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-0b37e30a-b4e6-41fe-90fe-aa0ede85b23d req-6e4179c1-379d-4fa2-8c08-180c123e165a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032330 Oct 28 08:43:43.327105 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 368/681] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:43.817585 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-276798fc-5e05-4ae6-811c-ed4fb0edcc5b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:43.818518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-276798fc-5e05-4ae6-811c-ed4fb0edcc5b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:43.828854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-276798fc-5e05-4ae6-811c-ed4fb0edcc5b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.829300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-276798fc-5e05-4ae6-811c-ed4fb0edcc5b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.830118 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-276798fc-5e05-4ae6-811c-ed4fb0edcc5b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.830560 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-276798fc-5e05-4ae6-811c-ed4fb0edcc5b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.947124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-276798fc-5e05-4ae6-811c-ed4fb0edcc5b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.130255 Oct 28 08:43:43.947124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 314/682] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:43 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:44.146283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fac23f2e-6697-4356-a825-4693c293c888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:44.147012 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fac23f2e-6697-4356-a825-4693c293c888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] [instance: c70c146b-a5ed-43af-aad8-18fb35f2dab5] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:44.154869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fac23f2e-6697-4356-a825-4693c293c888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.155317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fac23f2e-6697-4356-a825-4693c293c888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.156100 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fac23f2e-6697-4356-a825-4693c293c888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.156562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fac23f2e-6697-4356-a825-4693c293c888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.171991 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-fac23f2e-6697-4356-a825-4693c293c888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] HTTP exception thrown: Instance c70c146b-a5ed-43af-aad8-18fb35f2dab5 could not be found. Oct 28 08:43:44.172982 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fac23f2e-6697-4356-a825-4693c293c888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] Returning 404 to user: Instance c70c146b-a5ed-43af-aad8-18fb35f2dab5 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:43:44.173464 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fac23f2e-6697-4356-a825-4693c293c888 tempest-ServerRescueNegativeTestJSON-977598919 tempest-ServerRescueNegativeTestJSON-977598919-project] 10.222.0.74 "GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5" status: 404 len: 111 microversion: 2.1 time: 0.032375 Oct 28 08:43:44.174122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 369/683] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:44 2021] GET /compute/v2.1/servers/c70c146b-a5ed-43af-aad8-18fb35f2dab5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:43:44.220222 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8bc48512-b280-4acf-a140-032b7566ba7e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0bae53e-94db-4bf4-95ca-d454caeae752"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:44.221364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8bc48512-b280-4acf-a140-032b7566ba7e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:44.229440 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8bc48512-b280-4acf-a140-032b7566ba7e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.229917 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8bc48512-b280-4acf-a140-032b7566ba7e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.230687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8bc48512-b280-4acf-a140-032b7566ba7e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.231113 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8bc48512-b280-4acf-a140-032b7566ba7e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.526472 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8bc48512-b280-4acf-a140-032b7566ba7e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310428 Oct 28 08:43:44.527236 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 315/684] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:43:44 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:44.957983 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-334bdce0-ea06-46e9-b8da-2508a1eff897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:44.958811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-334bdce0-ea06-46e9-b8da-2508a1eff897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:44.966125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-334bdce0-ea06-46e9-b8da-2508a1eff897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.966575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-334bdce0-ea06-46e9-b8da-2508a1eff897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.967375 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-334bdce0-ea06-46e9-b8da-2508a1eff897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.967787 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-334bdce0-ea06-46e9-b8da-2508a1eff897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:45.025672 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e329d9e8-8de9-4ce8-bfa8-1f01dbb5a94d tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:45.026386 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e329d9e8-8de9-4ce8-bfa8-1f01dbb5a94d tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:45.034438 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e329d9e8-8de9-4ce8-bfa8-1f01dbb5a94d tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:45.035148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e329d9e8-8de9-4ce8-bfa8-1f01dbb5a94d tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:45.036349 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e329d9e8-8de9-4ce8-bfa8-1f01dbb5a94d tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:45.037519 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e329d9e8-8de9-4ce8-bfa8-1f01dbb5a94d tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:45.049964 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-334bdce0-ea06-46e9-b8da-2508a1eff897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.095669 Oct 28 08:43:45.050754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 370/685] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:44 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:45.177449 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.objects.instance [None req-e329d9e8-8de9-4ce8-bfa8-1f01dbb5a94d tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lazy-loading 'services' on Instance uuid 7b242f3a-0fab-4607-8a43-80c4d15255c6 {{(pid=132796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:45.315556 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e329d9e8-8de9-4ce8-bfa8-1f01dbb5a94d tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "DELETE /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6/os-volume_attachments/74fe9774-d172-4ad2-aa3a-9299fd293d70" status: 202 len: 0 microversion: 2.1 time: 0.296247 Oct 28 08:43:45.316583 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 316/686] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:43:45 2021] DELETE /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6/os-volume_attachments/74fe9774-d172-4ad2-aa3a-9299fd293d70 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:46.068511 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f05953c4-ddda-4b1e-b59d-c1c93e9894a3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:46.069479 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f05953c4-ddda-4b1e-b59d-c1c93e9894a3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:46.098284 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f05953c4-ddda-4b1e-b59d-c1c93e9894a3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:46.098759 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f05953c4-ddda-4b1e-b59d-c1c93e9894a3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:46.099593 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f05953c4-ddda-4b1e-b59d-c1c93e9894a3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:46.100030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f05953c4-ddda-4b1e-b59d-c1c93e9894a3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:46.177252 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f05953c4-ddda-4b1e-b59d-c1c93e9894a3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.117820 Oct 28 08:43:46.183198 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 371/687] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:46 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:47.190797 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ea31cd61-2984-4405-9ee6-e7a87c06176c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:47.191936 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ea31cd61-2984-4405-9ee6-e7a87c06176c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:47.199503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ea31cd61-2984-4405-9ee6-e7a87c06176c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:47.199949 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ea31cd61-2984-4405-9ee6-e7a87c06176c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:47.200740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ea31cd61-2984-4405-9ee6-e7a87c06176c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:47.201324 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ea31cd61-2984-4405-9ee6-e7a87c06176c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:47.274956 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ea31cd61-2984-4405-9ee6-e7a87c06176c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.087758 Oct 28 08:43:47.275970 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 317/688] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:47 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:48.287574 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a5c5f422-7586-4cf2-b917-e38140ce55c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:48.289492 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a5c5f422-7586-4cf2-b917-e38140ce55c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:48.296533 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a5c5f422-7586-4cf2-b917-e38140ce55c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:48.297002 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a5c5f422-7586-4cf2-b917-e38140ce55c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:48.297805 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a5c5f422-7586-4cf2-b917-e38140ce55c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:48.298258 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a5c5f422-7586-4cf2-b917-e38140ce55c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:48.378298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a5c5f422-7586-4cf2-b917-e38140ce55c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.094967 Oct 28 08:43:48.379079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 372/689] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:48 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:49.392906 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fa325ef7-503b-4865-9dfe-bfdfeb02f39d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:49.394103 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fa325ef7-503b-4865-9dfe-bfdfeb02f39d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:49.403403 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa325ef7-503b-4865-9dfe-bfdfeb02f39d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:49.403882 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa325ef7-503b-4865-9dfe-bfdfeb02f39d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:49.404661 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa325ef7-503b-4865-9dfe-bfdfeb02f39d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:49.405092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa325ef7-503b-4865-9dfe-bfdfeb02f39d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:49.482302 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fa325ef7-503b-4865-9dfe-bfdfeb02f39d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.093761 Oct 28 08:43:49.486866 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 318/690] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:49 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:50.495511 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-baf698bc-14b5-4beb-8312-92cc9ae15763 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:50.496889 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-baf698bc-14b5-4beb-8312-92cc9ae15763 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:50.504565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-baf698bc-14b5-4beb-8312-92cc9ae15763 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:50.505018 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-baf698bc-14b5-4beb-8312-92cc9ae15763 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:50.505988 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-baf698bc-14b5-4beb-8312-92cc9ae15763 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:50.506543 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-baf698bc-14b5-4beb-8312-92cc9ae15763 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:50.581021 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-baf698bc-14b5-4beb-8312-92cc9ae15763 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.090171 Oct 28 08:43:50.584954 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 373/691] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:50 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:51.593454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d75a08f1-387c-4c1d-9a81-bacff598eff6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:51.594587 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d75a08f1-387c-4c1d-9a81-bacff598eff6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:51.602363 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d75a08f1-387c-4c1d-9a81-bacff598eff6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:51.603033 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d75a08f1-387c-4c1d-9a81-bacff598eff6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:51.603993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d75a08f1-387c-4c1d-9a81-bacff598eff6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:51.604419 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d75a08f1-387c-4c1d-9a81-bacff598eff6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:51.693602 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d75a08f1-387c-4c1d-9a81-bacff598eff6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.104342 Oct 28 08:43:51.695306 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 319/692] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:51 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:52.053703 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-447f2ee2-523e-4e24-8d21-9a06ce401562 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:52.061401 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-447f2ee2-523e-4e24-8d21-9a06ce401562 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.065629 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-447f2ee2-523e-4e24-8d21-9a06ce401562 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.152833 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-447f2ee2-523e-4e24-8d21-9a06ce401562 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Going to try to stop instance {{(pid=132797) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 08:43:52.202649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-447f2ee2-523e-4e24-8d21-9a06ce401562 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 202 len: 0 microversion: 2.1 time: 0.152853 Oct 28 08:43:52.203688 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 374/693] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:52 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:52.219035 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b631f093-4322-49af-af9e-0bb8dbdcfada tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:52.219738 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b631f093-4322-49af-af9e-0bb8dbdcfada tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:52.227376 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b631f093-4322-49af-af9e-0bb8dbdcfada tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.227821 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b631f093-4322-49af-af9e-0bb8dbdcfada tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.228601 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b631f093-4322-49af-af9e-0bb8dbdcfada tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.229031 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b631f093-4322-49af-af9e-0bb8dbdcfada tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.363568 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b631f093-4322-49af-af9e-0bb8dbdcfada tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:52.372950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b631f093-4322-49af-af9e-0bb8dbdcfada tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.161268 Oct 28 08:43:52.373682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 320/694] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:52 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:52.707308 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-da39fd48-ad6b-4bf5-a68e-7ef8dfa367dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:52.708389 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-da39fd48-ad6b-4bf5-a68e-7ef8dfa367dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:52.715513 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-da39fd48-ad6b-4bf5-a68e-7ef8dfa367dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.715958 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-da39fd48-ad6b-4bf5-a68e-7ef8dfa367dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.716726 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-da39fd48-ad6b-4bf5-a68e-7ef8dfa367dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.717165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-da39fd48-ad6b-4bf5-a68e-7ef8dfa367dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.801417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-da39fd48-ad6b-4bf5-a68e-7ef8dfa367dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.099000 Oct 28 08:43:52.807357 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 375/695] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:52 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:53.048851 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ac08039b-8773-4e74-97fc-72335c929101 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:53.049425 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ac08039b-8773-4e74-97fc-72335c929101 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:53.057435 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ac08039b-8773-4e74-97fc-72335c929101 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.058107 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ac08039b-8773-4e74-97fc-72335c929101 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.059238 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ac08039b-8773-4e74-97fc-72335c929101 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.060066 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ac08039b-8773-4e74-97fc-72335c929101 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.088379 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ac08039b-8773-4e74-97fc-72335c929101 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:43:53.175869 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ac08039b-8773-4e74-97fc-72335c929101 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "DELETE /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 204 len: 0 microversion: 2.1 time: 0.130395 Oct 28 08:43:53.176690 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 321/696] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:43:53 2021] DELETE /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:43:53.185874 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-57810821-a7c4-4ae0-b572-41b03e3eed61 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:53.187172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-57810821-a7c4-4ae0-b572-41b03e3eed61 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:53.193879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-57810821-a7c4-4ae0-b572-41b03e3eed61 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.194265 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-57810821-a7c4-4ae0-b572-41b03e3eed61 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.196243 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-57810821-a7c4-4ae0-b572-41b03e3eed61 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.196671 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-57810821-a7c4-4ae0-b572-41b03e3eed61 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.330589 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-57810821-a7c4-4ae0-b572-41b03e3eed61 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:53.339406 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-57810821-a7c4-4ae0-b572-41b03e3eed61 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1513 microversion: 2.1 time: 0.157551 Oct 28 08:43:53.339975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 376/697] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:53 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:53.392920 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-36fb96d1-fae1-4472-8e36-12a9bbad8994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:53.393609 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-36fb96d1-fae1-4472-8e36-12a9bbad8994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:53.400705 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36fb96d1-fae1-4472-8e36-12a9bbad8994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.401148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36fb96d1-fae1-4472-8e36-12a9bbad8994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.401956 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36fb96d1-fae1-4472-8e36-12a9bbad8994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.402391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36fb96d1-fae1-4472-8e36-12a9bbad8994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.538094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-36fb96d1-fae1-4472-8e36-12a9bbad8994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:53.546161 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-36fb96d1-fae1-4472-8e36-12a9bbad8994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.157144 Oct 28 08:43:53.546726 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 322/698] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:53 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:53.814498 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-34c1b970-b650-40b4-9b91-b4aef7819dd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:53.815416 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-34c1b970-b650-40b4-9b91-b4aef7819dd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:53.821936 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-34c1b970-b650-40b4-9b91-b4aef7819dd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.822385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-34c1b970-b650-40b4-9b91-b4aef7819dd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.823189 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-34c1b970-b650-40b4-9b91-b4aef7819dd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.823593 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-34c1b970-b650-40b4-9b91-b4aef7819dd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.952442 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-34c1b970-b650-40b4-9b91-b4aef7819dd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.141919 Oct 28 08:43:53.953859 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 377/699] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:53 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:54.359742 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1739d697-eba3-4a8a-8a0e-475ec362c5c0 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:54.360360 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1739d697-eba3-4a8a-8a0e-475ec362c5c0 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:54.367385 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1739d697-eba3-4a8a-8a0e-475ec362c5c0 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.368357 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1739d697-eba3-4a8a-8a0e-475ec362c5c0 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.369133 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1739d697-eba3-4a8a-8a0e-475ec362c5c0 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.369563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1739d697-eba3-4a8a-8a0e-475ec362c5c0 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.516762 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1739d697-eba3-4a8a-8a0e-475ec362c5c0 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:54.525743 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1739d697-eba3-4a8a-8a0e-475ec362c5c0 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1513 microversion: 2.1 time: 0.172884 Oct 28 08:43:54.526647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 323/700] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:54 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:54.566695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-74e582bd-c2d6-451c-a06e-4152c2500fd6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:54.567306 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-74e582bd-c2d6-451c-a06e-4152c2500fd6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:54.577696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74e582bd-c2d6-451c-a06e-4152c2500fd6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.582060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74e582bd-c2d6-451c-a06e-4152c2500fd6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.583026 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74e582bd-c2d6-451c-a06e-4152c2500fd6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.583563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74e582bd-c2d6-451c-a06e-4152c2500fd6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.736062 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-74e582bd-c2d6-451c-a06e-4152c2500fd6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:54.745428 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-74e582bd-c2d6-451c-a06e-4152c2500fd6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.185120 Oct 28 08:43:54.753881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 378/701] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:54 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:54.964632 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e1e61e93-332e-49fe-9e6d-b29b9cded3f5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:54.965603 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e1e61e93-332e-49fe-9e6d-b29b9cded3f5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:54.971666 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1e61e93-332e-49fe-9e6d-b29b9cded3f5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.972108 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1e61e93-332e-49fe-9e6d-b29b9cded3f5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.972954 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1e61e93-332e-49fe-9e6d-b29b9cded3f5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.973384 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1e61e93-332e-49fe-9e6d-b29b9cded3f5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.039214 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e1e61e93-332e-49fe-9e6d-b29b9cded3f5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.078059 Oct 28 08:43:55.040493 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 324/702] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:54 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:55.542481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b16ec1eb-3a51-499e-9481-6caba218711b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:55.543149 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b16ec1eb-3a51-499e-9481-6caba218711b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:55.550071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b16ec1eb-3a51-499e-9481-6caba218711b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:55.550987 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b16ec1eb-3a51-499e-9481-6caba218711b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.552155 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b16ec1eb-3a51-499e-9481-6caba218711b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:55.552776 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b16ec1eb-3a51-499e-9481-6caba218711b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.714953 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b16ec1eb-3a51-499e-9481-6caba218711b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:55.724763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b16ec1eb-3a51-499e-9481-6caba218711b tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1513 microversion: 2.1 time: 0.186159 Oct 28 08:43:55.735545 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 379/703] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:55 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:55.768733 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-031fd266-2e52-4efe-9de2-4637a47ad622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:55.769465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-031fd266-2e52-4efe-9de2-4637a47ad622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:55.777262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-031fd266-2e52-4efe-9de2-4637a47ad622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:55.777707 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-031fd266-2e52-4efe-9de2-4637a47ad622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.778510 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-031fd266-2e52-4efe-9de2-4637a47ad622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:55.778939 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-031fd266-2e52-4efe-9de2-4637a47ad622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.990031 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-031fd266-2e52-4efe-9de2-4637a47ad622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:56.001315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-031fd266-2e52-4efe-9de2-4637a47ad622 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.242301 Oct 28 08:43:56.013882 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 325/704] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:55 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:56.050369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-34cdca66-e816-4f72-8b91-c3144bb29792 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:56.051656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-34cdca66-e816-4f72-8b91-c3144bb29792 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:56.058274 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-34cdca66-e816-4f72-8b91-c3144bb29792 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.058716 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-34cdca66-e816-4f72-8b91-c3144bb29792 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.059568 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-34cdca66-e816-4f72-8b91-c3144bb29792 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.059962 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-34cdca66-e816-4f72-8b91-c3144bb29792 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.138235 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-34cdca66-e816-4f72-8b91-c3144bb29792 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.091295 Oct 28 08:43:56.139007 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 380/705] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:56 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:56.268929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-333b445b-aa2c-4913-9546-c5058725bd5a req-d5db0e01-82ef-4203-a62a-9a5ba58b40de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b242f3a-0fab-4607-8a43-80c4d15255c6", "name": "network-vif-deleted", "tag": "b5f4ba07-a5b6-40dc-b577-c707a79bc3d0"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:56.271081 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:56.271081 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:43:56.283639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-333b445b-aa2c-4913-9546-c5058725bd5a req-d5db0e01-82ef-4203-a62a-9a5ba58b40de service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.284590 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-333b445b-aa2c-4913-9546-c5058725bd5a req-d5db0e01-82ef-4203-a62a-9a5ba58b40de service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.305032 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-333b445b-aa2c-4913-9546-c5058725bd5a req-d5db0e01-82ef-4203-a62a-9a5ba58b40de service nova] Creating event network-vif-deleted:b5f4ba07-a5b6-40dc-b577-c707a79bc3d0 for instance 7b242f3a-0fab-4607-8a43-80c4d15255c6 on hv-cinder-81566 Oct 28 08:43:56.311192 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-333b445b-aa2c-4913-9546-c5058725bd5a req-d5db0e01-82ef-4203-a62a-9a5ba58b40de service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046726 Oct 28 08:43:56.312214 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 326/706] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:56.743256 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:56.743951 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:56.751079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.751522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.752326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.752754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.791869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.792304 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.792743 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lazy-loading 'fault' on Instance uuid 7b242f3a-0fab-4607-8a43-80c4d15255c6 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:56.840093 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cde6e14d5b2432a918c5ffd26dc8335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d151ada161c47d4ae433054a67cdb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:56.846955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b69e32ca-4b9a-4e74-bf22-fc8ba6019537 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 200 len: 1309 microversion: 2.1 time: 0.108464 Oct 28 08:43:56.847517 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 381/707] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:56 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:57.020169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-170da7a9-0f63-46b1-ac11-8339a349c7c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:57.021291 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-170da7a9-0f63-46b1-ac11-8339a349c7c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:57.028451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-170da7a9-0f63-46b1-ac11-8339a349c7c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.029166 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-170da7a9-0f63-46b1-ac11-8339a349c7c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.029994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-170da7a9-0f63-46b1-ac11-8339a349c7c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.030492 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-170da7a9-0f63-46b1-ac11-8339a349c7c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.150285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6c66368e-2aab-4df8-8e65-7aa7bf736ac8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:57.151203 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6c66368e-2aab-4df8-8e65-7aa7bf736ac8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:57.155219 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-170da7a9-0f63-46b1-ac11-8339a349c7c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:57.157164 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c66368e-2aab-4df8-8e65-7aa7bf736ac8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.157616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c66368e-2aab-4df8-8e65-7aa7bf736ac8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.158416 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c66368e-2aab-4df8-8e65-7aa7bf736ac8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.158845 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c66368e-2aab-4df8-8e65-7aa7bf736ac8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.163208 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-170da7a9-0f63-46b1-ac11-8339a349c7c0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.147566 Oct 28 08:43:57.163966 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 327/708] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:57 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:57.222937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6c66368e-2aab-4df8-8e65-7aa7bf736ac8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.077003 Oct 28 08:43:57.223614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 382/709] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:57 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:57.865122 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2f54e3d8-e22d-4b72-9722-54f790562e93 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:57.865637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2f54e3d8-e22d-4b72-9722-54f790562e93 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] [instance: 7b242f3a-0fab-4607-8a43-80c4d15255c6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:57.873484 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f54e3d8-e22d-4b72-9722-54f790562e93 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.874176 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f54e3d8-e22d-4b72-9722-54f790562e93 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.875083 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f54e3d8-e22d-4b72-9722-54f790562e93 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.875552 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2f54e3d8-e22d-4b72-9722-54f790562e93 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.889701 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-2f54e3d8-e22d-4b72-9722-54f790562e93 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] HTTP exception thrown: Instance 7b242f3a-0fab-4607-8a43-80c4d15255c6 could not be found. Oct 28 08:43:57.890331 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2f54e3d8-e22d-4b72-9722-54f790562e93 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] Returning 404 to user: Instance 7b242f3a-0fab-4607-8a43-80c4d15255c6 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:43:57.891148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2f54e3d8-e22d-4b72-9722-54f790562e93 tempest-VolumesSnapshotTestJSON-340919065 tempest-VolumesSnapshotTestJSON-340919065-project] 10.222.0.74 "GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6" status: 404 len: 111 microversion: 2.1 time: 0.029916 Oct 28 08:43:57.891665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 328/710] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:57 2021] GET /compute/v2.1/servers/7b242f3a-0fab-4607-8a43-80c4d15255c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:43:58.182937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9fcddc2d-f399-44ec-8944-d6fb191b3f63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:58.183816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9fcddc2d-f399-44ec-8944-d6fb191b3f63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:58.192167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9fcddc2d-f399-44ec-8944-d6fb191b3f63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:58.192524 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9fcddc2d-f399-44ec-8944-d6fb191b3f63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:58.193354 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9fcddc2d-f399-44ec-8944-d6fb191b3f63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:58.194091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9fcddc2d-f399-44ec-8944-d6fb191b3f63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:58.235302 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-709380ab-eeb0-4a5c-ad1f-442fc79acdf4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:58.236370 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-709380ab-eeb0-4a5c-ad1f-442fc79acdf4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:58.244615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-709380ab-eeb0-4a5c-ad1f-442fc79acdf4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:58.245066 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-709380ab-eeb0-4a5c-ad1f-442fc79acdf4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:58.245938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-709380ab-eeb0-4a5c-ad1f-442fc79acdf4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:58.246392 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-709380ab-eeb0-4a5c-ad1f-442fc79acdf4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:58.329402 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9fcddc2d-f399-44ec-8944-d6fb191b3f63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:58.338793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9fcddc2d-f399-44ec-8944-d6fb191b3f63 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.161410 Oct 28 08:43:58.339366 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 383/711] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:58 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:58.364067 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-709380ab-eeb0-4a5c-ad1f-442fc79acdf4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.132243 Oct 28 08:43:58.364712 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 329/712] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:58 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:59.359426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bde344ed-e631-470d-899f-8ff786eab568 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:59.359426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bde344ed-e631-470d-899f-8ff786eab568 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:59.361929 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bde344ed-e631-470d-899f-8ff786eab568 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.362396 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bde344ed-e631-470d-899f-8ff786eab568 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.363304 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bde344ed-e631-470d-899f-8ff786eab568 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.363683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bde344ed-e631-470d-899f-8ff786eab568 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.376847 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3eeca126-0c42-4511-ad26-33b647cc5ad9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:59.378615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3eeca126-0c42-4511-ad26-33b647cc5ad9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:59.389394 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3eeca126-0c42-4511-ad26-33b647cc5ad9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.389892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3eeca126-0c42-4511-ad26-33b647cc5ad9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.390700 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3eeca126-0c42-4511-ad26-33b647cc5ad9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.391129 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3eeca126-0c42-4511-ad26-33b647cc5ad9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.462116 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3eeca126-0c42-4511-ad26-33b647cc5ad9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.089417 Oct 28 08:43:59.462758 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 330/713] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:59 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:59.507101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-bde344ed-e631-470d-899f-8ff786eab568 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:59.515023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bde344ed-e631-470d-899f-8ff786eab568 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.164014 Oct 28 08:43:59.515592 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 384/714] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:59 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:00.363169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1075435653", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-21201921", "security_groups": [{"name": "tempest-secgroup-smoke-1557192688"}], "block_device_mapping_v2": [{"uuid": "9304ef6e-fbcf-46c0-ae05-14ad8ac6652b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c4e2068-440b-4c5b-b064-f6b110ee163c"}]}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:00.474154 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ed80533b-0505-4f7b-af02-4fe97acd9a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:00.474542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ed80533b-0505-4f7b-af02-4fe97acd9a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:00.475092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] validate_networks() for [('5c4e2068-440b-4c5b-b064-f6b110ee163c', None, None, None, None, None)] {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:44:00.481649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed80533b-0505-4f7b-af02-4fe97acd9a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:00.482230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed80533b-0505-4f7b-af02-4fe97acd9a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:00.483098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed80533b-0505-4f7b-af02-4fe97acd9a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:00.483528 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed80533b-0505-4f7b-af02-4fe97acd9a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:00.869554 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:44:00.870298 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:44:00.871201 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:44:00.871781 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:44:00.872369 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:44:00.884668 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:00.885126 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:00.885950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:00.886414 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:00.903409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Getting quotas for project 3f8be4e851fc4c5bb989b23068ab50b0. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:44:00.907221 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Getting quotas for user c731f20a04204d9ea0b04a20f2e72577 and project 3f8be4e851fc4c5bb989b23068ab50b0. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:44:00.966994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:44:00.969234 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9304ef6e-fbcf-46c0-ae05-14ad8ac6652b',volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:44:01.102032 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: ERROR oslo.messaging._drivers.impl_rabbit [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [ffd3d545-181e-4e87-bb9e-151b5d1e4adf] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 08:44:02.118563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO oslo.messaging._drivers.impl_rabbit [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [ffd3d545-181e-4e87-bb9e-151b5d1e4adf] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 42118. Oct 28 08:44:02.123043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-29efa97f-63d6-48ff-ae13-f47203f1a76f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.763918 Oct 28 08:44:02.123706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 331/715] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:44:00 2021] POST /compute/v2.1/servers => generated 406 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:44:02.129254 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-08a234b5-e02d-41a5-b47c-053369cd5a89 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:02.129892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-08a234b5-e02d-41a5-b47c-053369cd5a89 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:02.136734 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-08a234b5-e02d-41a5-b47c-053369cd5a89 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:02.137181 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-08a234b5-e02d-41a5-b47c-053369cd5a89 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:02.137984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-08a234b5-e02d-41a5-b47c-053369cd5a89 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:02.138415 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-08a234b5-e02d-41a5-b47c-053369cd5a89 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:02.267337 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-08a234b5-e02d-41a5-b47c-053369cd5a89 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:02.276391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-08a234b5-e02d-41a5-b47c-053369cd5a89 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.151366 Oct 28 08:44:02.277022 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 332/716] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:02 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:02.281498 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5316baf8-4f37-42c8-9c76-967d82f7d57b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:02.282184 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5316baf8-4f37-42c8-9c76-967d82f7d57b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:02.334723 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5316baf8-4f37-42c8-9c76-967d82f7d57b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:02.342546 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5316baf8-4f37-42c8-9c76-967d82f7d57b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1093 microversion: 2.1 time: 0.064549 Oct 28 08:44:02.343126 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 333/717] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:02 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:03.294228 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f1607969-1f92-4eca-a21f-f63caf550caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:03.294913 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f1607969-1f92-4eca-a21f-f63caf550caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:03.301091 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f1607969-1f92-4eca-a21f-f63caf550caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:03.301533 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f1607969-1f92-4eca-a21f-f63caf550caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:03.302314 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f1607969-1f92-4eca-a21f-f63caf550caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:03.302748 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f1607969-1f92-4eca-a21f-f63caf550caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:03.671192 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f1607969-1f92-4eca-a21f-f63caf550caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:03.685378 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f1607969-1f92-4eca-a21f-f63caf550caf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.394204 Oct 28 08:44:03.686517 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 334/718] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:03 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:03.695257 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-489e1f51-2d78-47b6-bd09-75737aa2c164 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:03.696889 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-489e1f51-2d78-47b6-bd09-75737aa2c164 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:03.732318 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ed80533b-0505-4f7b-af02-4fe97acd9a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 3.262264 Oct 28 08:44:03.736387 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 385/719] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:00 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 3264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:03.773233 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-489e1f51-2d78-47b6-bd09-75737aa2c164 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:03.781235 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-489e1f51-2d78-47b6-bd09-75737aa2c164 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1093 microversion: 2.1 time: 0.093138 Oct 28 08:44:03.781869 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 335/720] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:03 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1093 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:04.705537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ac6f8688-08ef-4dba-94d2-ed20c06e4333 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:04.706329 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ac6f8688-08ef-4dba-94d2-ed20c06e4333 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:04.714967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac6f8688-08ef-4dba-94d2-ed20c06e4333 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:04.715408 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac6f8688-08ef-4dba-94d2-ed20c06e4333 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:04.716189 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac6f8688-08ef-4dba-94d2-ed20c06e4333 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:04.716631 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac6f8688-08ef-4dba-94d2-ed20c06e4333 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:04.744168 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-cf3ef911-9440-4f6e-b72c-df37417494b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:04.745760 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-cf3ef911-9440-4f6e-b72c-df37417494b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:04.752692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cf3ef911-9440-4f6e-b72c-df37417494b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:04.753130 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cf3ef911-9440-4f6e-b72c-df37417494b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:04.753928 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cf3ef911-9440-4f6e-b72c-df37417494b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:04.754561 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cf3ef911-9440-4f6e-b72c-df37417494b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:04.819522 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-cf3ef911-9440-4f6e-b72c-df37417494b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.078846 Oct 28 08:44:04.820647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 336/721] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:04 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:04.825829 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a37d5364-c3f1-4656-bdab-69e5df91b336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:04.827605 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a37d5364-c3f1-4656-bdab-69e5df91b336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:04.860043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ac6f8688-08ef-4dba-94d2-ed20c06e4333 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:04.870247 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ac6f8688-08ef-4dba-94d2-ed20c06e4333 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.169188 Oct 28 08:44:04.871570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 386/722] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:04 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:04.897989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a37d5364-c3f1-4656-bdab-69e5df91b336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:04.906080 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a37d5364-c3f1-4656-bdab-69e5df91b336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1093 microversion: 2.1 time: 0.084044 Oct 28 08:44:04.906716 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 337/723] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:04 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:05.832309 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a0a5bfd1-d8aa-40c9-a6f8-8c6d7f32473d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:05.833225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a0a5bfd1-d8aa-40c9-a6f8-8c6d7f32473d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:05.839574 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0a5bfd1-d8aa-40c9-a6f8-8c6d7f32473d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.840016 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0a5bfd1-d8aa-40c9-a6f8-8c6d7f32473d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.840780 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0a5bfd1-d8aa-40c9-a6f8-8c6d7f32473d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.841208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0a5bfd1-d8aa-40c9-a6f8-8c6d7f32473d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.888096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-30738ac5-aa2b-45eb-b3ad-67bd724a0099 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:05.888729 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-30738ac5-aa2b-45eb-b3ad-67bd724a0099 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:05.895259 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-30738ac5-aa2b-45eb-b3ad-67bd724a0099 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.895706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-30738ac5-aa2b-45eb-b3ad-67bd724a0099 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.896471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-30738ac5-aa2b-45eb-b3ad-67bd724a0099 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.896904 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-30738ac5-aa2b-45eb-b3ad-67bd724a0099 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.903294 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a0a5bfd1-d8aa-40c9-a6f8-8c6d7f32473d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.074544 Oct 28 08:44:05.903943 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 387/724] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:05 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:05.924636 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8abfe303-be5d-4364-8987-733266544d5e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:05.925343 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8abfe303-be5d-4364-8987-733266544d5e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:05.933298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8abfe303-be5d-4364-8987-733266544d5e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.933747 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8abfe303-be5d-4364-8987-733266544d5e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.934575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8abfe303-be5d-4364-8987-733266544d5e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.935011 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8abfe303-be5d-4364-8987-733266544d5e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:06.016083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8abfe303-be5d-4364-8987-733266544d5e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:06.025188 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8abfe303-be5d-4364-8987-733266544d5e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1143 microversion: 2.1 time: 0.104310 Oct 28 08:44:06.026300 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 388/725] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:05 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1143 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:06.069698 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-30738ac5-aa2b-45eb-b3ad-67bd724a0099 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:06.077948 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-30738ac5-aa2b-45eb-b3ad-67bd724a0099 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.193780 Oct 28 08:44:06.078512 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 338/726] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:05 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:06.916307 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-407ee881-7f28-47b1-aa81-2ff8e6789329 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:06.917216 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-407ee881-7f28-47b1-aa81-2ff8e6789329 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:06.924560 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-407ee881-7f28-47b1-aa81-2ff8e6789329 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:06.925115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-407ee881-7f28-47b1-aa81-2ff8e6789329 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:06.925916 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-407ee881-7f28-47b1-aa81-2ff8e6789329 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:06.926395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-407ee881-7f28-47b1-aa81-2ff8e6789329 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:06.991448 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-407ee881-7f28-47b1-aa81-2ff8e6789329 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.079625 Oct 28 08:44:06.992117 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 389/727] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:06 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:07.043098 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-af2054bf-72f6-4c86-96ba-e329f0e50a68 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:07.043710 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-af2054bf-72f6-4c86-96ba-e329f0e50a68 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:07.053715 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-af2054bf-72f6-4c86-96ba-e329f0e50a68 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:07.054226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-af2054bf-72f6-4c86-96ba-e329f0e50a68 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:07.055097 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-af2054bf-72f6-4c86-96ba-e329f0e50a68 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:07.055531 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-af2054bf-72f6-4c86-96ba-e329f0e50a68 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:07.116077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-af2054bf-72f6-4c86-96ba-e329f0e50a68 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:07.124127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-af2054bf-72f6-4c86-96ba-e329f0e50a68 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1191 microversion: 2.1 time: 0.085573 Oct 28 08:44:07.124697 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 339/728] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:07 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:07.141271 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5f702bed-5204-4b3f-8d03-07258b61c6f9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:07.142249 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5f702bed-5204-4b3f-8d03-07258b61c6f9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:07.151435 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5f702bed-5204-4b3f-8d03-07258b61c6f9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:07.152306 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5f702bed-5204-4b3f-8d03-07258b61c6f9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:07.153458 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5f702bed-5204-4b3f-8d03-07258b61c6f9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:07.155377 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5f702bed-5204-4b3f-8d03-07258b61c6f9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:07.318028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5f702bed-5204-4b3f-8d03-07258b61c6f9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:07.331467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5f702bed-5204-4b3f-8d03-07258b61c6f9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.194520 Oct 28 08:44:07.337834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 390/729] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:07 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:08.003485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-327cc363-8108-41b8-bfd5-063e8ec46eac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:08.004444 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-327cc363-8108-41b8-bfd5-063e8ec46eac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:08.021478 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-327cc363-8108-41b8-bfd5-063e8ec46eac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.022559 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-327cc363-8108-41b8-bfd5-063e8ec46eac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.023846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-327cc363-8108-41b8-bfd5-063e8ec46eac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.024492 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-327cc363-8108-41b8-bfd5-063e8ec46eac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.107431 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-327cc363-8108-41b8-bfd5-063e8ec46eac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.107471 Oct 28 08:44:08.111702 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 340/730] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:07 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:08.151029 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f9535511-52a0-4a21-908b-197dcfb573a7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:08.152173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f9535511-52a0-4a21-908b-197dcfb573a7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:08.158606 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9535511-52a0-4a21-908b-197dcfb573a7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.159049 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9535511-52a0-4a21-908b-197dcfb573a7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.159831 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9535511-52a0-4a21-908b-197dcfb573a7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.160265 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9535511-52a0-4a21-908b-197dcfb573a7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.301214 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f9535511-52a0-4a21-908b-197dcfb573a7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:08.309904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f9535511-52a0-4a21-908b-197dcfb573a7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1277 microversion: 2.1 time: 0.163533 Oct 28 08:44:08.310405 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 391/731] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:08 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:08.356526 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-eae5e9d3-0892-4e6a-9e13-022719f2a404 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:08.356944 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-eae5e9d3-0892-4e6a-9e13-022719f2a404 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:08.363772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-eae5e9d3-0892-4e6a-9e13-022719f2a404 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.364257 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-eae5e9d3-0892-4e6a-9e13-022719f2a404 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.365038 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-eae5e9d3-0892-4e6a-9e13-022719f2a404 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.365470 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-eae5e9d3-0892-4e6a-9e13-022719f2a404 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.574453 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-eae5e9d3-0892-4e6a-9e13-022719f2a404 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:08.584791 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-eae5e9d3-0892-4e6a-9e13-022719f2a404 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1723 microversion: 2.1 time: 0.233353 Oct 28 08:44:08.590747 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 341/732] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:08 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:08.770065 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-a94e55f0-b3d0-4f96-b9de-a92ad4fc3198 req-6f2cb4a4-7704-4bdc-94c6-1198d1eb7c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1aa424-5de3-486c-af93-d2e0b411fa1a", "tag": "da56e668-59c2-40dc-8745-6f9ac628122a"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:08.773064 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:44:08.773064 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:44:08.786459 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-a94e55f0-b3d0-4f96-b9de-a92ad4fc3198 req-6f2cb4a4-7704-4bdc-94c6-1198d1eb7c16 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.786967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-a94e55f0-b3d0-4f96-b9de-a92ad4fc3198 req-6f2cb4a4-7704-4bdc-94c6-1198d1eb7c16 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.804132 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-a94e55f0-b3d0-4f96-b9de-a92ad4fc3198 req-6f2cb4a4-7704-4bdc-94c6-1198d1eb7c16 service nova] Creating event network-changed:da56e668-59c2-40dc-8745-6f9ac628122a for instance 5d1aa424-5de3-486c-af93-d2e0b411fa1a on hv-cinder-81566 Oct 28 08:44:08.809520 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-a94e55f0-b3d0-4f96-b9de-a92ad4fc3198 req-6f2cb4a4-7704-4bdc-94c6-1198d1eb7c16 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042942 Oct 28 08:44:08.810240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 392/733] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:44:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:44:09.120254 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a75bf41a-7bcd-4161-b668-045ea45d60e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:09.121435 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a75bf41a-7bcd-4161-b668-045ea45d60e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:09.128072 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a75bf41a-7bcd-4161-b668-045ea45d60e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.128632 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a75bf41a-7bcd-4161-b668-045ea45d60e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.129496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a75bf41a-7bcd-4161-b668-045ea45d60e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.130124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a75bf41a-7bcd-4161-b668-045ea45d60e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.329296 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0d9da98b-aefc-43e6-a976-0338fe8d2d7f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:09.330030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0d9da98b-aefc-43e6-a976-0338fe8d2d7f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:09.340241 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0d9da98b-aefc-43e6-a976-0338fe8d2d7f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.340932 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0d9da98b-aefc-43e6-a976-0338fe8d2d7f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.342103 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0d9da98b-aefc-43e6-a976-0338fe8d2d7f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.342720 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0d9da98b-aefc-43e6-a976-0338fe8d2d7f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.482884 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0d9da98b-aefc-43e6-a976-0338fe8d2d7f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:09.490403 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0d9da98b-aefc-43e6-a976-0338fe8d2d7f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.165575 Oct 28 08:44:09.490963 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 393/734] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:09 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:09.604305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-331ff7c9-6997-410c-be41-706658286dbc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:09.604820 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-331ff7c9-6997-410c-be41-706658286dbc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:09.610730 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-331ff7c9-6997-410c-be41-706658286dbc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.611172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-331ff7c9-6997-410c-be41-706658286dbc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.611934 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-331ff7c9-6997-410c-be41-706658286dbc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.612361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-331ff7c9-6997-410c-be41-706658286dbc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.738497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-331ff7c9-6997-410c-be41-706658286dbc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:09.746654 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-331ff7c9-6997-410c-be41-706658286dbc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1700 microversion: 2.1 time: 0.146235 Oct 28 08:44:09.747230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 394/735] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:09 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1700 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:09.762828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-86538715-f59f-49d6-8d33-bd74ae9796ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:09.768483 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-86538715-f59f-49d6-8d33-bd74ae9796ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.768941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-86538715-f59f-49d6-8d33-bd74ae9796ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.791517 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-86538715-f59f-49d6-8d33-bd74ae9796ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Going to try to start instance {{(pid=132797) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 08:44:09.834665 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-86538715-f59f-49d6-8d33-bd74ae9796ee tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 202 len: 0 microversion: 2.1 time: 0.075094 Oct 28 08:44:09.835270 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 395/736] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:09 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:09.844820 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-47733ecd-e054-4714-9a7d-46435f1106cf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:09.845525 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-47733ecd-e054-4714-9a7d-46435f1106cf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:09.851869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-47733ecd-e054-4714-9a7d-46435f1106cf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.852340 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-47733ecd-e054-4714-9a7d-46435f1106cf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.853124 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-47733ecd-e054-4714-9a7d-46435f1106cf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.853558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-47733ecd-e054-4714-9a7d-46435f1106cf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.978702 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-47733ecd-e054-4714-9a7d-46435f1106cf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:09.986514 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-47733ecd-e054-4714-9a7d-46435f1106cf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1709 microversion: 2.1 time: 0.145764 Oct 28 08:44:09.987104 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 396/737] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:09 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1709 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:10.507330 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-20d3becc-1df6-45a4-88e0-80257a485e7a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:10.508677 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-20d3becc-1df6-45a4-88e0-80257a485e7a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:10.515898 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-20d3becc-1df6-45a4-88e0-80257a485e7a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:10.516814 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-20d3becc-1df6-45a4-88e0-80257a485e7a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:10.518158 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-20d3becc-1df6-45a4-88e0-80257a485e7a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:10.518831 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-20d3becc-1df6-45a4-88e0-80257a485e7a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:10.661495 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-20d3becc-1df6-45a4-88e0-80257a485e7a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:10.670937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-20d3becc-1df6-45a4-88e0-80257a485e7a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.167329 Oct 28 08:44:10.671537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 397/738] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:10 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:11.009345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dd2b2502-7b04-42aa-8e64-a0e306e2b928 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:11.009924 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dd2b2502-7b04-42aa-8e64-a0e306e2b928 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:11.016045 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd2b2502-7b04-42aa-8e64-a0e306e2b928 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:11.016487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd2b2502-7b04-42aa-8e64-a0e306e2b928 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:11.017249 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd2b2502-7b04-42aa-8e64-a0e306e2b928 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:11.017672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd2b2502-7b04-42aa-8e64-a0e306e2b928 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:11.161475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dd2b2502-7b04-42aa-8e64-a0e306e2b928 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:11.169941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dd2b2502-7b04-42aa-8e64-a0e306e2b928 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1709 microversion: 2.1 time: 0.166188 Oct 28 08:44:11.170583 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 398/739] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:11 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1709 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:11.692002 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dea8c0c7-c951-47ae-86b6-0f1e2fb31336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:11.692649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dea8c0c7-c951-47ae-86b6-0f1e2fb31336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:11.699772 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dea8c0c7-c951-47ae-86b6-0f1e2fb31336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:11.700218 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dea8c0c7-c951-47ae-86b6-0f1e2fb31336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:11.700989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dea8c0c7-c951-47ae-86b6-0f1e2fb31336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:11.701422 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dea8c0c7-c951-47ae-86b6-0f1e2fb31336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:11.831954 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dea8c0c7-c951-47ae-86b6-0f1e2fb31336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:11.840022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dea8c0c7-c951-47ae-86b6-0f1e2fb31336 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.151779 Oct 28 08:44:11.840588 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 399/740] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:11 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:12.187389 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-72995376-55ae-4b6e-911b-5db705c4e352 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:12.188031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-72995376-55ae-4b6e-911b-5db705c4e352 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:12.194488 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-72995376-55ae-4b6e-911b-5db705c4e352 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:12.194923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-72995376-55ae-4b6e-911b-5db705c4e352 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:12.195876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-72995376-55ae-4b6e-911b-5db705c4e352 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:12.196501 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-72995376-55ae-4b6e-911b-5db705c4e352 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:12.323363 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-72995376-55ae-4b6e-911b-5db705c4e352 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:12.331160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-72995376-55ae-4b6e-911b-5db705c4e352 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1709 microversion: 2.1 time: 0.147646 Oct 28 08:44:12.331727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 400/741] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:12 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1709 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:12.856625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-62e30f51-c2d7-4574-a00c-dd97dc99f7fd tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:12.857329 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-62e30f51-c2d7-4574-a00c-dd97dc99f7fd tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:12.864525 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-62e30f51-c2d7-4574-a00c-dd97dc99f7fd tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:12.864970 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-62e30f51-c2d7-4574-a00c-dd97dc99f7fd tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:12.866427 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-62e30f51-c2d7-4574-a00c-dd97dc99f7fd tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:12.866864 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-62e30f51-c2d7-4574-a00c-dd97dc99f7fd tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:12.872290 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a75bf41a-7bcd-4161-b668-045ea45d60e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 3.756261 Oct 28 08:44:12.877820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 342/742] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:09 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 3763 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:13.040288 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-62e30f51-c2d7-4574-a00c-dd97dc99f7fd tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:13.048568 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-62e30f51-c2d7-4574-a00c-dd97dc99f7fd tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.195706 Oct 28 08:44:13.049296 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 401/743] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:12 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:13.348862 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0b03dc16-e6b3-48a1-afcf-af26754689e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:13.349559 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0b03dc16-e6b3-48a1-afcf-af26754689e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:13.356957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b03dc16-e6b3-48a1-afcf-af26754689e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:13.357403 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b03dc16-e6b3-48a1-afcf-af26754689e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:13.358202 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b03dc16-e6b3-48a1-afcf-af26754689e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:13.358639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b03dc16-e6b3-48a1-afcf-af26754689e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:13.571879 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0b03dc16-e6b3-48a1-afcf-af26754689e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:13.579691 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0b03dc16-e6b3-48a1-afcf-af26754689e4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1709 microversion: 2.1 time: 0.234960 Oct 28 08:44:13.580259 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 343/744] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:13 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1709 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:13.883725 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-cd35413f-7820-4065-bbd7-86e0c554256b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:13.884758 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-cd35413f-7820-4065-bbd7-86e0c554256b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:13.891635 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cd35413f-7820-4065-bbd7-86e0c554256b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:13.892087 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cd35413f-7820-4065-bbd7-86e0c554256b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:13.892852 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cd35413f-7820-4065-bbd7-86e0c554256b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:13.893281 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cd35413f-7820-4065-bbd7-86e0c554256b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:13.977347 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-cd35413f-7820-4065-bbd7-86e0c554256b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.096562 Oct 28 08:44:13.981260 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 402/745] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:13 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:14.067357 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3875fe85-3b40-4d97-a977-ab5d33abcd69 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:14.068075 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3875fe85-3b40-4d97-a977-ab5d33abcd69 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:14.076438 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3875fe85-3b40-4d97-a977-ab5d33abcd69 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:14.077417 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3875fe85-3b40-4d97-a977-ab5d33abcd69 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:14.078235 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3875fe85-3b40-4d97-a977-ab5d33abcd69 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:14.078671 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3875fe85-3b40-4d97-a977-ab5d33abcd69 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:14.229336 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3875fe85-3b40-4d97-a977-ab5d33abcd69 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:14.237335 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3875fe85-3b40-4d97-a977-ab5d33abcd69 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.173717 Oct 28 08:44:14.247269 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 344/746] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:14 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:14.596915 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9505b6c7-e355-4e44-b8fb-f63a992ac212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:14.597680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9505b6c7-e355-4e44-b8fb-f63a992ac212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:14.606353 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9505b6c7-e355-4e44-b8fb-f63a992ac212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:14.606797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9505b6c7-e355-4e44-b8fb-f63a992ac212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:14.607565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9505b6c7-e355-4e44-b8fb-f63a992ac212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:14.607990 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9505b6c7-e355-4e44-b8fb-f63a992ac212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:14.751247 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9505b6c7-e355-4e44-b8fb-f63a992ac212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:14.762436 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9505b6c7-e355-4e44-b8fb-f63a992ac212 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1709 microversion: 2.1 time: 0.169451 Oct 28 08:44:14.763083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 403/747] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:14 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:14.989259 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6e14b49c-b5eb-4696-9a53-30e20d03b954 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:14.990429 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6e14b49c-b5eb-4696-9a53-30e20d03b954 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:14.998651 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e14b49c-b5eb-4696-9a53-30e20d03b954 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:14.999097 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e14b49c-b5eb-4696-9a53-30e20d03b954 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:14.999872 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e14b49c-b5eb-4696-9a53-30e20d03b954 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:15.000353 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6e14b49c-b5eb-4696-9a53-30e20d03b954 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:15.085351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6e14b49c-b5eb-4696-9a53-30e20d03b954 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.100283 Oct 28 08:44:15.086015 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 345/748] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:14 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:15.254925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-66680d12-0a27-4393-9237-5886f1a82d2f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:15.255508 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-66680d12-0a27-4393-9237-5886f1a82d2f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:15.262706 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66680d12-0a27-4393-9237-5886f1a82d2f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:15.263151 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66680d12-0a27-4393-9237-5886f1a82d2f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:15.265678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66680d12-0a27-4393-9237-5886f1a82d2f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:15.266238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66680d12-0a27-4393-9237-5886f1a82d2f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:15.403588 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-66680d12-0a27-4393-9237-5886f1a82d2f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:15.411688 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-66680d12-0a27-4393-9237-5886f1a82d2f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.160444 Oct 28 08:44:15.412258 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 404/749] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:15 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:15.781229 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a533039b-29a0-4d13-9886-914e343746cd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:15.781967 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a533039b-29a0-4d13-9886-914e343746cd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:15.788908 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a533039b-29a0-4d13-9886-914e343746cd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:15.789834 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a533039b-29a0-4d13-9886-914e343746cd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:15.790599 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a533039b-29a0-4d13-9886-914e343746cd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:15.791036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a533039b-29a0-4d13-9886-914e343746cd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:15.940438 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a533039b-29a0-4d13-9886-914e343746cd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:15.950262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a533039b-29a0-4d13-9886-914e343746cd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1713 microversion: 2.1 time: 0.172901 Oct 28 08:44:15.956095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 346/750] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:15 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1713 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:16.097865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f070c8bd-22e5-4da5-b925-ac77fc0411cc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:16.098803 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f070c8bd-22e5-4da5-b925-ac77fc0411cc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:16.106319 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f070c8bd-22e5-4da5-b925-ac77fc0411cc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:16.107192 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f070c8bd-22e5-4da5-b925-ac77fc0411cc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:16.107978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f070c8bd-22e5-4da5-b925-ac77fc0411cc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:16.108412 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f070c8bd-22e5-4da5-b925-ac77fc0411cc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:16.192433 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f070c8bd-22e5-4da5-b925-ac77fc0411cc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.099216 Oct 28 08:44:16.193127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 405/751] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:16 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:16.429496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e3c9a9ee-be65-4570-8f70-9b308c6476ec tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:16.430322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e3c9a9ee-be65-4570-8f70-9b308c6476ec tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:16.437194 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c9a9ee-be65-4570-8f70-9b308c6476ec tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:16.437630 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c9a9ee-be65-4570-8f70-9b308c6476ec tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:16.438462 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c9a9ee-be65-4570-8f70-9b308c6476ec tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:16.438879 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c9a9ee-be65-4570-8f70-9b308c6476ec tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:16.567407 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e3c9a9ee-be65-4570-8f70-9b308c6476ec tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:16.575107 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e3c9a9ee-be65-4570-8f70-9b308c6476ec tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.148820 Oct 28 08:44:16.585544 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 347/752] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:16 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:17.204747 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-197da508-fb00-4074-8efd-57dc3a6c35c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:17.205886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-197da508-fb00-4074-8efd-57dc3a6c35c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:17.213465 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-197da508-fb00-4074-8efd-57dc3a6c35c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:17.213943 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-197da508-fb00-4074-8efd-57dc3a6c35c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:17.214762 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-197da508-fb00-4074-8efd-57dc3a6c35c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:17.215202 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-197da508-fb00-4074-8efd-57dc3a6c35c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:17.281562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-197da508-fb00-4074-8efd-57dc3a6c35c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.080763 Oct 28 08:44:17.282512 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 406/753] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:17 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:17.595119 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c36f3890-e434-4f78-afb9-189e1463e8fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:17.595769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c36f3890-e434-4f78-afb9-189e1463e8fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:17.603193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c36f3890-e434-4f78-afb9-189e1463e8fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:17.603638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c36f3890-e434-4f78-afb9-189e1463e8fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:17.604405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c36f3890-e434-4f78-afb9-189e1463e8fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:17.604832 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c36f3890-e434-4f78-afb9-189e1463e8fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:17.776419 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c36f3890-e434-4f78-afb9-189e1463e8fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:17.792785 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c36f3890-e434-4f78-afb9-189e1463e8fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.201212 Oct 28 08:44:17.793468 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 348/754] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:17 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:18.294368 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b40be050-239b-4113-ade4-d76214ef87a5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:18.295549 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b40be050-239b-4113-ade4-d76214ef87a5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:18.302617 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b40be050-239b-4113-ade4-d76214ef87a5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:18.303585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b40be050-239b-4113-ade4-d76214ef87a5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:18.304826 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b40be050-239b-4113-ade4-d76214ef87a5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:18.305633 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b40be050-239b-4113-ade4-d76214ef87a5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:18.377242 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b40be050-239b-4113-ade4-d76214ef87a5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.086836 Oct 28 08:44:18.378675 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 407/755] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:18 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:18.810413 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4c63c28a-c781-45d4-8d98-102361e9f331 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:18.811346 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4c63c28a-c781-45d4-8d98-102361e9f331 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:18.823215 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4c63c28a-c781-45d4-8d98-102361e9f331 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:18.824509 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4c63c28a-c781-45d4-8d98-102361e9f331 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:18.825816 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4c63c28a-c781-45d4-8d98-102361e9f331 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:18.826463 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4c63c28a-c781-45d4-8d98-102361e9f331 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:19.001093 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4c63c28a-c781-45d4-8d98-102361e9f331 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:19.010239 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4c63c28a-c781-45d4-8d98-102361e9f331 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.203304 Oct 28 08:44:19.010805 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 349/756] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:18 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:19.391704 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-740f3288-0ddc-49d2-8e5d-ca3fc6bb8767 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:19.392716 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-740f3288-0ddc-49d2-8e5d-ca3fc6bb8767 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:19.401334 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-740f3288-0ddc-49d2-8e5d-ca3fc6bb8767 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:19.401799 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-740f3288-0ddc-49d2-8e5d-ca3fc6bb8767 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:19.402702 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-740f3288-0ddc-49d2-8e5d-ca3fc6bb8767 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:19.403214 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-740f3288-0ddc-49d2-8e5d-ca3fc6bb8767 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:19.475074 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-740f3288-0ddc-49d2-8e5d-ca3fc6bb8767 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.087703 Oct 28 08:44:19.481037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 408/757] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:19 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:20.027962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d6b32543-873a-4c82-a0ad-808561f4c29b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:20.029469 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d6b32543-873a-4c82-a0ad-808561f4c29b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:20.038663 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d6b32543-873a-4c82-a0ad-808561f4c29b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:20.039788 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d6b32543-873a-4c82-a0ad-808561f4c29b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:20.041185 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d6b32543-873a-4c82-a0ad-808561f4c29b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:20.041615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d6b32543-873a-4c82-a0ad-808561f4c29b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:20.178681 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d6b32543-873a-4c82-a0ad-808561f4c29b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:20.187640 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d6b32543-873a-4c82-a0ad-808561f4c29b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.164316 Oct 28 08:44:20.188242 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 350/758] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:20 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:20.384519 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-1dd8ee58-9a36-4d19-af6b-7577d08d0706 req-84349443-4875-4080-baed-4e629d4b7515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1aa424-5de3-486c-af93-d2e0b411fa1a", "name": "network-vif-plugged", "status": "completed", "tag": "da56e668-59c2-40dc-8745-6f9ac628122a"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:20.386926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:44:20.386926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:44:20.411406 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-1dd8ee58-9a36-4d19-af6b-7577d08d0706 req-84349443-4875-4080-baed-4e629d4b7515 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:20.412096 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-1dd8ee58-9a36-4d19-af6b-7577d08d0706 req-84349443-4875-4080-baed-4e629d4b7515 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:20.424418 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-1dd8ee58-9a36-4d19-af6b-7577d08d0706 req-84349443-4875-4080-baed-4e629d4b7515 service nova] Creating event network-vif-plugged:da56e668-59c2-40dc-8745-6f9ac628122a for instance 5d1aa424-5de3-486c-af93-d2e0b411fa1a on hv-cinder-81566 Oct 28 08:44:20.429538 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-1dd8ee58-9a36-4d19-af6b-7577d08d0706 req-84349443-4875-4080-baed-4e629d4b7515 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049409 Oct 28 08:44:20.430250 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 409/759] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:44:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:44:20.488716 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4bd69fee-030d-4596-aa42-b7585598aff3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:20.489621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4bd69fee-030d-4596-aa42-b7585598aff3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:20.495891 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4bd69fee-030d-4596-aa42-b7585598aff3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:20.496335 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4bd69fee-030d-4596-aa42-b7585598aff3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:20.497114 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4bd69fee-030d-4596-aa42-b7585598aff3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:20.497680 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4bd69fee-030d-4596-aa42-b7585598aff3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:20.579220 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4bd69fee-030d-4596-aa42-b7585598aff3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.094030 Oct 28 08:44:20.583262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 351/760] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:20 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:21.205119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8cebecf5-9950-4b86-96de-10f678cab8f0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:21.205821 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8cebecf5-9950-4b86-96de-10f678cab8f0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:21.212020 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8cebecf5-9950-4b86-96de-10f678cab8f0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:21.212462 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8cebecf5-9950-4b86-96de-10f678cab8f0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:21.213250 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8cebecf5-9950-4b86-96de-10f678cab8f0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:21.213899 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8cebecf5-9950-4b86-96de-10f678cab8f0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:21.360781 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8cebecf5-9950-4b86-96de-10f678cab8f0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:21.368898 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8cebecf5-9950-4b86-96de-10f678cab8f0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1265 microversion: 2.1 time: 0.168036 Oct 28 08:44:21.369470 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 410/761] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:21 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:21.591766 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-600c9ef3-3bb5-4b79-98e4-fa8ef17a64c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:21.592880 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-600c9ef3-3bb5-4b79-98e4-fa8ef17a64c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:21.600146 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-600c9ef3-3bb5-4b79-98e4-fa8ef17a64c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:21.600594 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-600c9ef3-3bb5-4b79-98e4-fa8ef17a64c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:21.601384 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-600c9ef3-3bb5-4b79-98e4-fa8ef17a64c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:21.602399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-600c9ef3-3bb5-4b79-98e4-fa8ef17a64c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:21.693669 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-600c9ef3-3bb5-4b79-98e4-fa8ef17a64c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.105840 Oct 28 08:44:21.694368 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 352/762] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:21 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:22.388416 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-aeb17052-8977-4c35-8bdf-9e4bd44799ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:22.389196 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-aeb17052-8977-4c35-8bdf-9e4bd44799ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:22.396048 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aeb17052-8977-4c35-8bdf-9e4bd44799ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:22.396487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aeb17052-8977-4c35-8bdf-9e4bd44799ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:22.397253 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aeb17052-8977-4c35-8bdf-9e4bd44799ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:22.397676 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-aeb17052-8977-4c35-8bdf-9e4bd44799ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:22.525875 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-aeb17052-8977-4c35-8bdf-9e4bd44799ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:22.533882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-aeb17052-8977-4c35-8bdf-9e4bd44799ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1452 microversion: 2.1 time: 0.151525 Oct 28 08:44:22.534632 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 411/763] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:22 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:22.551598 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-13fae652-125f-4a84-b49b-6483738ddd83 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:22.552324 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-13fae652-125f-4a84-b49b-6483738ddd83 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:22.559386 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-13fae652-125f-4a84-b49b-6483738ddd83 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:22.559834 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-13fae652-125f-4a84-b49b-6483738ddd83 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:22.560608 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-13fae652-125f-4a84-b49b-6483738ddd83 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:22.561044 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-13fae652-125f-4a84-b49b-6483738ddd83 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:22.693074 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-13fae652-125f-4a84-b49b-6483738ddd83 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:22.701687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-13fae652-125f-4a84-b49b-6483738ddd83 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1452 microversion: 2.1 time: 0.153870 Oct 28 08:44:22.702289 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 353/764] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:22 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:22.706064 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-96248174-3423-4258-bd35-1fd1bbf413e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:22.706979 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-96248174-3423-4258-bd35-1fd1bbf413e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:22.713980 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-96248174-3423-4258-bd35-1fd1bbf413e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:22.714736 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-96248174-3423-4258-bd35-1fd1bbf413e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:22.715183 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-96248174-3423-4258-bd35-1fd1bbf413e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:22.715611 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-96248174-3423-4258-bd35-1fd1bbf413e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:22.778263 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-96248174-3423-4258-bd35-1fd1bbf413e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.075706 Oct 28 08:44:22.782227 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 412/765] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:22 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:23.790092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-48448342-7617-43e2-89ff-2efd8bc8c0db tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:23.791376 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-48448342-7617-43e2-89ff-2efd8bc8c0db tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:23.798048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-48448342-7617-43e2-89ff-2efd8bc8c0db tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:23.798496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-48448342-7617-43e2-89ff-2efd8bc8c0db tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:23.799272 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-48448342-7617-43e2-89ff-2efd8bc8c0db tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:23.799710 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-48448342-7617-43e2-89ff-2efd8bc8c0db tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:24.122577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-48448342-7617-43e2-89ff-2efd8bc8c0db tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.336634 Oct 28 08:44:24.126631 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 354/766] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:23 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:25.136528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ca3d45f0-735f-4037-ae19-528dc6e76918 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:25.137216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ca3d45f0-735f-4037-ae19-528dc6e76918 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:25.140369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-8bfa874a-5ba1-41e9-8762-26562da15123 req-904884f6-073d-4dd3-9a82-660d838b4215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1aa424-5de3-486c-af93-d2e0b411fa1a", "tag": "da56e668-59c2-40dc-8745-6f9ac628122a"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:25.142537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:44:25.142537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:44:25.149159 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ca3d45f0-735f-4037-ae19-528dc6e76918 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:25.150655 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ca3d45f0-735f-4037-ae19-528dc6e76918 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:25.151599 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-8bfa874a-5ba1-41e9-8762-26562da15123 req-904884f6-073d-4dd3-9a82-660d838b4215 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:25.151975 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ca3d45f0-735f-4037-ae19-528dc6e76918 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:25.152118 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-8bfa874a-5ba1-41e9-8762-26562da15123 req-904884f6-073d-4dd3-9a82-660d838b4215 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:25.152781 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ca3d45f0-735f-4037-ae19-528dc6e76918 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:25.167803 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-8bfa874a-5ba1-41e9-8762-26562da15123 req-904884f6-073d-4dd3-9a82-660d838b4215 service nova] Creating event network-changed:da56e668-59c2-40dc-8745-6f9ac628122a for instance 5d1aa424-5de3-486c-af93-d2e0b411fa1a on hv-cinder-81566 Oct 28 08:44:25.173187 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-8bfa874a-5ba1-41e9-8762-26562da15123 req-904884f6-073d-4dd3-9a82-660d838b4215 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046890 Oct 28 08:44:25.176941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 413/767] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:44:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:44:27.810772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ca3d45f0-735f-4037-ae19-528dc6e76918 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 2.679524 Oct 28 08:44:27.811465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 355/768] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:25 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 2681 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:28.823506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-55183cb1-939e-46c2-b4a6-31a701fc2582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:28.824419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-55183cb1-939e-46c2-b4a6-31a701fc2582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:28.833980 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-55183cb1-939e-46c2-b4a6-31a701fc2582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:28.834510 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-55183cb1-939e-46c2-b4a6-31a701fc2582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:28.835318 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-55183cb1-939e-46c2-b4a6-31a701fc2582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:28.835748 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-55183cb1-939e-46c2-b4a6-31a701fc2582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:28.900686 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-55183cb1-939e-46c2-b4a6-31a701fc2582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.081330 Oct 28 08:44:28.901650 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 414/769] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:28 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:29.912929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ae2b4f42-3a35-48aa-a4e7-ad9d30706e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:29.913945 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ae2b4f42-3a35-48aa-a4e7-ad9d30706e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:29.922135 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae2b4f42-3a35-48aa-a4e7-ad9d30706e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:29.922553 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae2b4f42-3a35-48aa-a4e7-ad9d30706e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:29.923375 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae2b4f42-3a35-48aa-a4e7-ad9d30706e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:29.923824 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ae2b4f42-3a35-48aa-a4e7-ad9d30706e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:32.561266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ae2b4f42-3a35-48aa-a4e7-ad9d30706e6f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 2.652228 Oct 28 08:44:32.562000 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 356/770] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:29 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 2654 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:33.573576 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1c54c469-893e-4742-b887-405fde29263b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:33.574607 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1c54c469-893e-4742-b887-405fde29263b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:33.581762 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1c54c469-893e-4742-b887-405fde29263b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:33.582232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1c54c469-893e-4742-b887-405fde29263b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:33.583013 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1c54c469-893e-4742-b887-405fde29263b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:33.583438 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1c54c469-893e-4742-b887-405fde29263b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:33.660807 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1c54c469-893e-4742-b887-405fde29263b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.091651 Oct 28 08:44:33.661463 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 415/771] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:33 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:34.673158 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9740b35d-fc2c-44b3-9f92-d5a8fb1acdcd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:34.674179 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9740b35d-fc2c-44b3-9f92-d5a8fb1acdcd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:34.683958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9740b35d-fc2c-44b3-9f92-d5a8fb1acdcd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:34.684393 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9740b35d-fc2c-44b3-9f92-d5a8fb1acdcd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:34.685173 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9740b35d-fc2c-44b3-9f92-d5a8fb1acdcd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:34.685597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9740b35d-fc2c-44b3-9f92-d5a8fb1acdcd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:34.772927 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9740b35d-fc2c-44b3-9f92-d5a8fb1acdcd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.103646 Oct 28 08:44:34.773611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 357/772] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:34 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:35.786285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-01f15ca4-fc07-48ba-8bb0-0a7ae1472af6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:35.787272 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-01f15ca4-fc07-48ba-8bb0-0a7ae1472af6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:35.794526 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01f15ca4-fc07-48ba-8bb0-0a7ae1472af6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:35.794974 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01f15ca4-fc07-48ba-8bb0-0a7ae1472af6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:35.795727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01f15ca4-fc07-48ba-8bb0-0a7ae1472af6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:35.796147 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01f15ca4-fc07-48ba-8bb0-0a7ae1472af6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:35.885656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-01f15ca4-fc07-48ba-8bb0-0a7ae1472af6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.103251 Oct 28 08:44:35.886373 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 416/773] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:35 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:36.898499 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-50cf97b0-bc55-40dd-a9a1-7f9d81719a14 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:36.899645 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-50cf97b0-bc55-40dd-a9a1-7f9d81719a14 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:36.906906 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50cf97b0-bc55-40dd-a9a1-7f9d81719a14 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:36.907344 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50cf97b0-bc55-40dd-a9a1-7f9d81719a14 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:36.908101 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50cf97b0-bc55-40dd-a9a1-7f9d81719a14 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:36.908537 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50cf97b0-bc55-40dd-a9a1-7f9d81719a14 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:37.073886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-50cf97b0-bc55-40dd-a9a1-7f9d81719a14 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.179203 Oct 28 08:44:37.074550 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 358/774] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:36 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:38.085912 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d5dfb8d9-2021-4029-939e-056490de6689 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:38.087623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d5dfb8d9-2021-4029-939e-056490de6689 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:38.094438 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5dfb8d9-2021-4029-939e-056490de6689 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:38.094883 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5dfb8d9-2021-4029-939e-056490de6689 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:38.095649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5dfb8d9-2021-4029-939e-056490de6689 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:38.096084 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5dfb8d9-2021-4029-939e-056490de6689 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:40.494055 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d5dfb8d9-2021-4029-939e-056490de6689 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 2.411545 Oct 28 08:44:40.494751 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 417/775] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:38 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:41.506479 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0609a8c0-9807-4eeb-bdf6-87c7d2a0d61c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:41.507538 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0609a8c0-9807-4eeb-bdf6-87c7d2a0d61c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:41.515511 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0609a8c0-9807-4eeb-bdf6-87c7d2a0d61c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:41.515946 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0609a8c0-9807-4eeb-bdf6-87c7d2a0d61c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:41.516712 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0609a8c0-9807-4eeb-bdf6-87c7d2a0d61c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:41.517136 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0609a8c0-9807-4eeb-bdf6-87c7d2a0d61c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:41.599186 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0609a8c0-9807-4eeb-bdf6-87c7d2a0d61c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.096680 Oct 28 08:44:41.600143 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 359/776] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:41 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:42.611933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e3989337-d5af-4441-b7f2-76aa5099edd1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:42.612933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e3989337-d5af-4441-b7f2-76aa5099edd1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:42.621124 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e3989337-d5af-4441-b7f2-76aa5099edd1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:42.621566 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e3989337-d5af-4441-b7f2-76aa5099edd1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:42.622365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e3989337-d5af-4441-b7f2-76aa5099edd1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:42.622803 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e3989337-d5af-4441-b7f2-76aa5099edd1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:42.705910 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e3989337-d5af-4441-b7f2-76aa5099edd1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.097752 Oct 28 08:44:42.706626 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 418/777] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:42 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:43.718189 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-49602499-f6c5-44dc-89eb-8910b3cf8233 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:43.719196 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-49602499-f6c5-44dc-89eb-8910b3cf8233 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:43.726216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49602499-f6c5-44dc-89eb-8910b3cf8233 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:43.726662 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49602499-f6c5-44dc-89eb-8910b3cf8233 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:43.727434 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49602499-f6c5-44dc-89eb-8910b3cf8233 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:43.727878 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-49602499-f6c5-44dc-89eb-8910b3cf8233 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:43.800113 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-49602499-f6c5-44dc-89eb-8910b3cf8233 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.085878 Oct 28 08:44:43.801067 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 360/778] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:43 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:44.812630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1865d636-69df-4bf0-a31e-f3e83b709799 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:44.813666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1865d636-69df-4bf0-a31e-f3e83b709799 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:44.820646 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1865d636-69df-4bf0-a31e-f3e83b709799 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:44.821088 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1865d636-69df-4bf0-a31e-f3e83b709799 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:44.822456 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1865d636-69df-4bf0-a31e-f3e83b709799 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:44.823026 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1865d636-69df-4bf0-a31e-f3e83b709799 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:44.890089 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1865d636-69df-4bf0-a31e-f3e83b709799 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 28626 microversion: 2.20 time: 0.081363 Oct 28 08:44:44.890752 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 419/779] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:44 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 28626 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:45.906180 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5507a6b1-471f-44a8-970a-210434c24b05 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:45.907191 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5507a6b1-471f-44a8-970a-210434c24b05 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:45.915299 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5507a6b1-471f-44a8-970a-210434c24b05 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:45.915812 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5507a6b1-471f-44a8-970a-210434c24b05 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:45.916606 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5507a6b1-471f-44a8-970a-210434c24b05 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:45.917041 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5507a6b1-471f-44a8-970a-210434c24b05 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:46.002517 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5507a6b1-471f-44a8-970a-210434c24b05 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 29912 microversion: 2.20 time: 0.100234 Oct 28 08:44:46.003182 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 361/780] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:45 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 29912 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:47.015260 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-908a43f2-26ca-4c14-9f4f-a382d63feac9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:47.016404 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-908a43f2-26ca-4c14-9f4f-a382d63feac9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:47.023087 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-908a43f2-26ca-4c14-9f4f-a382d63feac9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:47.023548 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-908a43f2-26ca-4c14-9f4f-a382d63feac9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:47.024387 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-908a43f2-26ca-4c14-9f4f-a382d63feac9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:47.024818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-908a43f2-26ca-4c14-9f4f-a382d63feac9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:47.117413 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-908a43f2-26ca-4c14-9f4f-a382d63feac9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 31668 microversion: 2.20 time: 0.106227 Oct 28 08:44:47.121713 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 420/781] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:47 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 31668 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:48.129244 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-361d469f-a800-4cca-a5a7-48aa0d587cb8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:48.130253 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-361d469f-a800-4cca-a5a7-48aa0d587cb8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:48.137707 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-361d469f-a800-4cca-a5a7-48aa0d587cb8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:48.138171 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-361d469f-a800-4cca-a5a7-48aa0d587cb8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:48.138925 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-361d469f-a800-4cca-a5a7-48aa0d587cb8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:48.139349 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-361d469f-a800-4cca-a5a7-48aa0d587cb8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:48.216484 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-361d469f-a800-4cca-a5a7-48aa0d587cb8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 32954 microversion: 2.20 time: 0.091170 Oct 28 08:44:48.217025 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 362/782] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:48 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 32954 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:49.229060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0f45e65d-7de5-452a-bc43-93000a3845af tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:49.230130 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0f45e65d-7de5-452a-bc43-93000a3845af tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:49.237047 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f45e65d-7de5-452a-bc43-93000a3845af tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:49.237494 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f45e65d-7de5-452a-bc43-93000a3845af tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:49.238360 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f45e65d-7de5-452a-bc43-93000a3845af tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:49.238790 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f45e65d-7de5-452a-bc43-93000a3845af tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:49.328616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0f45e65d-7de5-452a-bc43-93000a3845af tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 33726 microversion: 2.20 time: 0.103658 Oct 28 08:44:49.329230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 421/783] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:49 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 33726 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:50.340445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-94e5add5-0dd1-48e1-a2d8-7ae2a50da86f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:50.341454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-94e5add5-0dd1-48e1-a2d8-7ae2a50da86f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:50.350137 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-94e5add5-0dd1-48e1-a2d8-7ae2a50da86f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:50.350570 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-94e5add5-0dd1-48e1-a2d8-7ae2a50da86f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:50.351352 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-94e5add5-0dd1-48e1-a2d8-7ae2a50da86f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:50.351987 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-94e5add5-0dd1-48e1-a2d8-7ae2a50da86f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:50.447594 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-94e5add5-0dd1-48e1-a2d8-7ae2a50da86f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 34950 microversion: 2.20 time: 0.110925 Oct 28 08:44:50.448350 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 363/784] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:50 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 34950 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:51.462417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f5b1d016-8bf2-4ca8-afc6-1d4bb34a7875 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:51.465872 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f5b1d016-8bf2-4ca8-afc6-1d4bb34a7875 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:51.473238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f5b1d016-8bf2-4ca8-afc6-1d4bb34a7875 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:51.473677 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f5b1d016-8bf2-4ca8-afc6-1d4bb34a7875 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:51.474482 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f5b1d016-8bf2-4ca8-afc6-1d4bb34a7875 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:51.474911 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f5b1d016-8bf2-4ca8-afc6-1d4bb34a7875 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:51.557189 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f5b1d016-8bf2-4ca8-afc6-1d4bb34a7875 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 36290 microversion: 2.20 time: 0.098052 Oct 28 08:44:51.558283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 422/785] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:51 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 36290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:52.570717 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5874befe-0723-4c35-90bd-bd6fe07ce72e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:52.571754 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5874befe-0723-4c35-90bd-bd6fe07ce72e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:52.579865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5874befe-0723-4c35-90bd-bd6fe07ce72e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:52.580361 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5874befe-0723-4c35-90bd-bd6fe07ce72e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:52.581141 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5874befe-0723-4c35-90bd-bd6fe07ce72e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:52.581577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5874befe-0723-4c35-90bd-bd6fe07ce72e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:52.662774 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5874befe-0723-4c35-90bd-bd6fe07ce72e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 37856 microversion: 2.20 time: 0.095904 Oct 28 08:44:52.663899 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 364/786] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:52 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 37856 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:53.676914 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d7fb2fa6-4748-4afc-9271-062f7581204c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:53.677940 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d7fb2fa6-4748-4afc-9271-062f7581204c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:53.686377 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7fb2fa6-4748-4afc-9271-062f7581204c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:53.686873 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7fb2fa6-4748-4afc-9271-062f7581204c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:53.687562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7fb2fa6-4748-4afc-9271-062f7581204c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:53.687987 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7fb2fa6-4748-4afc-9271-062f7581204c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:53.772119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d7fb2fa6-4748-4afc-9271-062f7581204c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 38176 microversion: 2.20 time: 0.099087 Oct 28 08:44:53.772783 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 423/787] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:53 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 38176 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:54.785522 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f29fb8d7-1b42-412b-83b8-8cc3209f13eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:54.786759 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f29fb8d7-1b42-412b-83b8-8cc3209f13eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:54.803243 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f29fb8d7-1b42-412b-83b8-8cc3209f13eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:54.803699 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f29fb8d7-1b42-412b-83b8-8cc3209f13eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:54.804501 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f29fb8d7-1b42-412b-83b8-8cc3209f13eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:54.804936 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f29fb8d7-1b42-412b-83b8-8cc3209f13eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:54.883841 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f29fb8d7-1b42-412b-83b8-8cc3209f13eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 38176 microversion: 2.20 time: 0.102685 Oct 28 08:44:54.884495 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 365/788] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:54 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 38176 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:55.896733 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6368e804-afae-4e7a-b404-11ff6e7e7e11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:55.897750 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6368e804-afae-4e7a-b404-11ff6e7e7e11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:55.906757 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6368e804-afae-4e7a-b404-11ff6e7e7e11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:55.907189 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6368e804-afae-4e7a-b404-11ff6e7e7e11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:55.907962 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6368e804-afae-4e7a-b404-11ff6e7e7e11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:55.908387 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6368e804-afae-4e7a-b404-11ff6e7e7e11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:55.975295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6368e804-afae-4e7a-b404-11ff6e7e7e11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 38176 microversion: 2.20 time: 0.082203 Oct 28 08:44:55.976033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 424/789] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:55 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 38176 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:56.987890 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1574fd24-bb51-4a5f-8c60-f957d3e23019 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:56.988775 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1574fd24-bb51-4a5f-8c60-f957d3e23019 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:56.996323 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1574fd24-bb51-4a5f-8c60-f957d3e23019 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:56.996767 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1574fd24-bb51-4a5f-8c60-f957d3e23019 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:56.997546 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1574fd24-bb51-4a5f-8c60-f957d3e23019 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:56.998003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1574fd24-bb51-4a5f-8c60-f957d3e23019 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:57.078917 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1574fd24-bb51-4a5f-8c60-f957d3e23019 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 38256 microversion: 2.20 time: 0.095017 Oct 28 08:44:57.079818 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 366/790] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:56 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 38256 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:58.092023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-97b78cba-89f3-4ae8-aa91-cab378f58775 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:58.093076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-97b78cba-89f3-4ae8-aa91-cab378f58775 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:58.101060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97b78cba-89f3-4ae8-aa91-cab378f58775 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:58.101593 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97b78cba-89f3-4ae8-aa91-cab378f58775 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:58.102416 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97b78cba-89f3-4ae8-aa91-cab378f58775 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:58.102856 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97b78cba-89f3-4ae8-aa91-cab378f58775 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:58.185109 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-97b78cba-89f3-4ae8-aa91-cab378f58775 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 200 len: 38317 microversion: 2.20 time: 0.097477 Oct 28 08:44:58.185764 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 425/791] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:58 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 38317 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:58.196524 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8b763d5e-1022-4ee4-a30e-99fb6010e17a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:58.198024 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8b763d5e-1022-4ee4-a30e-99fb6010e17a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:58.205421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8b763d5e-1022-4ee4-a30e-99fb6010e17a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:58.205890 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8b763d5e-1022-4ee4-a30e-99fb6010e17a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:58.206668 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8b763d5e-1022-4ee4-a30e-99fb6010e17a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:58.207096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8b763d5e-1022-4ee4-a30e-99fb6010e17a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:58.233456 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8b763d5e-1022-4ee4-a30e-99fb6010e17a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/ips" status: 200 len: 151 microversion: 2.20 time: 0.041284 Oct 28 08:44:58.233982 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 367/792] 10.222.0.74 () {60 vars in 1288 bytes} [Thu Oct 28 08:44:58 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:45:00.545418 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-eab4b905-d7bd-4d8e-ba07-46b8397d514e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:00.546082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-eab4b905-d7bd-4d8e-ba07-46b8397d514e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:00.553082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eab4b905-d7bd-4d8e-ba07-46b8397d514e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:00.553523 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eab4b905-d7bd-4d8e-ba07-46b8397d514e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:00.554324 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eab4b905-d7bd-4d8e-ba07-46b8397d514e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:00.554752 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eab4b905-d7bd-4d8e-ba07-46b8397d514e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:00.580114 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-eab4b905-d7bd-4d8e-ba07-46b8397d514e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lazy-loading 'flavor' on Instance uuid 423157c3-a1e9-43c5-8fda-01d1d93bd484 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:45:00.985324 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-eab4b905-d7bd-4d8e-ba07-46b8397d514e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 202 len: 0 microversion: 2.20 time: 0.444659 Oct 28 08:45:00.986065 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 426/793] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:45:00 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:45:00.995488 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b1172edb-3fe3-4c5d-ab31-6a54d92722ee tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:00.996229 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b1172edb-3fe3-4c5d-ab31-6a54d92722ee tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:01.012917 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b1172edb-3fe3-4c5d-ab31-6a54d92722ee tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:01.013358 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b1172edb-3fe3-4c5d-ab31-6a54d92722ee tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:01.014407 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b1172edb-3fe3-4c5d-ab31-6a54d92722ee tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:01.014849 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b1172edb-3fe3-4c5d-ab31-6a54d92722ee tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:01.252808 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b1172edb-3fe3-4c5d-ab31-6a54d92722ee tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:01.261356 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b1172edb-3fe3-4c5d-ab31-6a54d92722ee tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:01.263035 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b1172edb-3fe3-4c5d-ab31-6a54d92722ee tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:01.271556 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b1172edb-3fe3-4c5d-ab31-6a54d92722ee tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.280761 Oct 28 08:45:01.272151 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 368/794] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:00 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:02.293964 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6d683828-532d-4362-9993-694214ac4e46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:02.294659 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6d683828-532d-4362-9993-694214ac4e46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:02.300786 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d683828-532d-4362-9993-694214ac4e46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:02.301228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d683828-532d-4362-9993-694214ac4e46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:02.302015 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d683828-532d-4362-9993-694214ac4e46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:02.302449 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d683828-532d-4362-9993-694214ac4e46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:02.434038 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6d683828-532d-4362-9993-694214ac4e46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:02.442119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6d683828-532d-4362-9993-694214ac4e46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:02.444802 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6d683828-532d-4362-9993-694214ac4e46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:02.446122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6d683828-532d-4362-9993-694214ac4e46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.157339 Oct 28 08:45:02.446687 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 427/795] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:02 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:03.464650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-024381bf-2e1e-4d69-95ee-dfa5be8cdef4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:03.465420 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-024381bf-2e1e-4d69-95ee-dfa5be8cdef4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:03.472429 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-024381bf-2e1e-4d69-95ee-dfa5be8cdef4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:03.472875 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-024381bf-2e1e-4d69-95ee-dfa5be8cdef4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:03.473652 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-024381bf-2e1e-4d69-95ee-dfa5be8cdef4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:03.474117 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-024381bf-2e1e-4d69-95ee-dfa5be8cdef4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:03.613278 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-024381bf-2e1e-4d69-95ee-dfa5be8cdef4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:03.628556 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-024381bf-2e1e-4d69-95ee-dfa5be8cdef4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:03.630089 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-024381bf-2e1e-4d69-95ee-dfa5be8cdef4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:03.631310 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-024381bf-2e1e-4d69-95ee-dfa5be8cdef4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.170699 Oct 28 08:45:03.631885 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 369/796] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:03 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:04.649345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fd413185-e314-4c35-9ec5-e22bbd9c29f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:04.651127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fd413185-e314-4c35-9ec5-e22bbd9c29f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:04.658395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd413185-e314-4c35-9ec5-e22bbd9c29f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:04.658995 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd413185-e314-4c35-9ec5-e22bbd9c29f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:04.666763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd413185-e314-4c35-9ec5-e22bbd9c29f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:04.666763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd413185-e314-4c35-9ec5-e22bbd9c29f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:04.799827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fd413185-e314-4c35-9ec5-e22bbd9c29f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:04.808679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fd413185-e314-4c35-9ec5-e22bbd9c29f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:04.810330 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fd413185-e314-4c35-9ec5-e22bbd9c29f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:04.811493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fd413185-e314-4c35-9ec5-e22bbd9c29f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.165815 Oct 28 08:45:04.812289 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 428/797] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:04 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:05.829652 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-88aec651-627e-48c1-b5af-0144a57bb3b1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:05.830348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-88aec651-627e-48c1-b5af-0144a57bb3b1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:05.836702 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-88aec651-627e-48c1-b5af-0144a57bb3b1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:05.837148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-88aec651-627e-48c1-b5af-0144a57bb3b1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:05.838645 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-88aec651-627e-48c1-b5af-0144a57bb3b1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:05.839067 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-88aec651-627e-48c1-b5af-0144a57bb3b1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:05.970868 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-88aec651-627e-48c1-b5af-0144a57bb3b1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:05.982473 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-88aec651-627e-48c1-b5af-0144a57bb3b1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:05.983997 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-88aec651-627e-48c1-b5af-0144a57bb3b1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:05.985325 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-88aec651-627e-48c1-b5af-0144a57bb3b1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.159508 Oct 28 08:45:05.985902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 370/798] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:05 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:07.004509 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ec564c8e-7adb-4e5c-ad95-72d5455b9a88 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:07.005079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ec564c8e-7adb-4e5c-ad95-72d5455b9a88 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:07.012217 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ec564c8e-7adb-4e5c-ad95-72d5455b9a88 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:07.012664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ec564c8e-7adb-4e5c-ad95-72d5455b9a88 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:07.013448 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ec564c8e-7adb-4e5c-ad95-72d5455b9a88 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:07.013920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ec564c8e-7adb-4e5c-ad95-72d5455b9a88 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:07.148838 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ec564c8e-7adb-4e5c-ad95-72d5455b9a88 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:07.157772 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ec564c8e-7adb-4e5c-ad95-72d5455b9a88 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:07.159292 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ec564c8e-7adb-4e5c-ad95-72d5455b9a88 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:07.160449 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ec564c8e-7adb-4e5c-ad95-72d5455b9a88 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.159769 Oct 28 08:45:07.161013 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 429/799] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:06 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:08.179175 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c6af879a-3989-4b74-b029-4094e630c7eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:08.179757 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c6af879a-3989-4b74-b029-4094e630c7eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:08.186490 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6af879a-3989-4b74-b029-4094e630c7eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:08.186931 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6af879a-3989-4b74-b029-4094e630c7eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:08.187682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6af879a-3989-4b74-b029-4094e630c7eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:08.188106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6af879a-3989-4b74-b029-4094e630c7eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:08.311799 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c6af879a-3989-4b74-b029-4094e630c7eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:08.319666 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c6af879a-3989-4b74-b029-4094e630c7eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:08.321276 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c6af879a-3989-4b74-b029-4094e630c7eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:08.323135 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c6af879a-3989-4b74-b029-4094e630c7eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.147037 Oct 28 08:45:08.323704 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 371/800] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:08 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:08.715022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-85fe2240-450f-45cd-91c5-01b49fb00657 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:08.716028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-85fe2240-450f-45cd-91c5-01b49fb00657 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:08.722393 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-85fe2240-450f-45cd-91c5-01b49fb00657 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:08.722842 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-85fe2240-450f-45cd-91c5-01b49fb00657 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:08.723620 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-85fe2240-450f-45cd-91c5-01b49fb00657 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:08.724056 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-85fe2240-450f-45cd-91c5-01b49fb00657 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:08.800481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-85fe2240-450f-45cd-91c5-01b49fb00657 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "POST /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/action" status: 202 len: 0 microversion: 2.1 time: 0.089719 Oct 28 08:45:08.804190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 430/801] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:45:08 2021] POST /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:45:08.809087 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c8aee3df-6d2b-4c21-9e08-0c0df353360c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:08.809689 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c8aee3df-6d2b-4c21-9e08-0c0df353360c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:08.816040 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c8aee3df-6d2b-4c21-9e08-0c0df353360c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:08.816489 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c8aee3df-6d2b-4c21-9e08-0c0df353360c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:08.817262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c8aee3df-6d2b-4c21-9e08-0c0df353360c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:08.817881 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c8aee3df-6d2b-4c21-9e08-0c0df353360c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:08.981100 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c8aee3df-6d2b-4c21-9e08-0c0df353360c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:08.989043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c8aee3df-6d2b-4c21-9e08-0c0df353360c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1751 microversion: 2.1 time: 0.183444 Oct 28 08:45:08.989503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 372/802] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:08 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:09.342291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-234db7ab-634f-4d7a-90eb-0f7e15ce1ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:09.342981 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-234db7ab-634f-4d7a-90eb-0f7e15ce1ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:09.349033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-234db7ab-634f-4d7a-90eb-0f7e15ce1ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:09.349479 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-234db7ab-634f-4d7a-90eb-0f7e15ce1ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:09.350265 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-234db7ab-634f-4d7a-90eb-0f7e15ce1ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:09.350695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-234db7ab-634f-4d7a-90eb-0f7e15ce1ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:09.551932 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-234db7ab-634f-4d7a-90eb-0f7e15ce1ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:09.560827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-234db7ab-634f-4d7a-90eb-0f7e15ce1ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:09.562365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-234db7ab-634f-4d7a-90eb-0f7e15ce1ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:09.563559 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-234db7ab-634f-4d7a-90eb-0f7e15ce1ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.225483 Oct 28 08:45:09.564312 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 431/803] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:09 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:10.006852 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5a82ebed-4281-44d4-b269-afa181310e5e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:10.007505 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5a82ebed-4281-44d4-b269-afa181310e5e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:10.014476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a82ebed-4281-44d4-b269-afa181310e5e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.014926 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a82ebed-4281-44d4-b269-afa181310e5e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:10.015728 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a82ebed-4281-44d4-b269-afa181310e5e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.016163 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a82ebed-4281-44d4-b269-afa181310e5e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:10.147075 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5a82ebed-4281-44d4-b269-afa181310e5e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:10.156249 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5a82ebed-4281-44d4-b269-afa181310e5e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.152998 Oct 28 08:45:10.156831 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 373/804] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:10 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:10.581628 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5107e6c6-14d3-407e-89fd-48cf65ae6ade tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:10.582269 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5107e6c6-14d3-407e-89fd-48cf65ae6ade tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:10.589368 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5107e6c6-14d3-407e-89fd-48cf65ae6ade tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.589837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5107e6c6-14d3-407e-89fd-48cf65ae6ade tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:10.590615 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5107e6c6-14d3-407e-89fd-48cf65ae6ade tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.591050 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5107e6c6-14d3-407e-89fd-48cf65ae6ade tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:10.719826 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5107e6c6-14d3-407e-89fd-48cf65ae6ade tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:10.729037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5107e6c6-14d3-407e-89fd-48cf65ae6ade tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:10.730707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5107e6c6-14d3-407e-89fd-48cf65ae6ade tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:10.731882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5107e6c6-14d3-407e-89fd-48cf65ae6ade tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.154051 Oct 28 08:45:10.732451 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 432/805] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:10 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:11.173444 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bf7b583b-1a42-43fe-9b8a-93b80890f5fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:11.174022 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bf7b583b-1a42-43fe-9b8a-93b80890f5fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:11.180120 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf7b583b-1a42-43fe-9b8a-93b80890f5fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:11.180551 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf7b583b-1a42-43fe-9b8a-93b80890f5fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:11.181302 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf7b583b-1a42-43fe-9b8a-93b80890f5fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:11.182899 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bf7b583b-1a42-43fe-9b8a-93b80890f5fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:11.317581 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-bf7b583b-1a42-43fe-9b8a-93b80890f5fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:11.325853 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bf7b583b-1a42-43fe-9b8a-93b80890f5fa tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.156023 Oct 28 08:45:11.326443 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 374/806] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:11 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:11.750678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-58b9e618-264f-4681-a4cf-448eee800cc6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:11.751225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-58b9e618-264f-4681-a4cf-448eee800cc6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:11.757434 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-58b9e618-264f-4681-a4cf-448eee800cc6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:11.757913 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-58b9e618-264f-4681-a4cf-448eee800cc6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:11.758683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-58b9e618-264f-4681-a4cf-448eee800cc6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:11.759144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-58b9e618-264f-4681-a4cf-448eee800cc6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:11.882937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-58b9e618-264f-4681-a4cf-448eee800cc6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:11.891788 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-58b9e618-264f-4681-a4cf-448eee800cc6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:11.893366 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-58b9e618-264f-4681-a4cf-448eee800cc6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:11.894560 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-58b9e618-264f-4681-a4cf-448eee800cc6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.148293 Oct 28 08:45:11.895187 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 433/807] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:11 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:12.344356 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a50f7f79-08b3-4317-9545-fe9eafcc1acb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:12.344985 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a50f7f79-08b3-4317-9545-fe9eafcc1acb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:12.352970 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a50f7f79-08b3-4317-9545-fe9eafcc1acb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:12.353489 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a50f7f79-08b3-4317-9545-fe9eafcc1acb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:12.354405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a50f7f79-08b3-4317-9545-fe9eafcc1acb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:12.354865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a50f7f79-08b3-4317-9545-fe9eafcc1acb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:12.761849 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a50f7f79-08b3-4317-9545-fe9eafcc1acb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:12.772010 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a50f7f79-08b3-4317-9545-fe9eafcc1acb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.432031 Oct 28 08:45:12.772608 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 375/808] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:12 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:12.913623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-51565cf8-8b4b-4025-9f87-33d77a9d744d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:12.914262 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-51565cf8-8b4b-4025-9f87-33d77a9d744d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:12.923059 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-51565cf8-8b4b-4025-9f87-33d77a9d744d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:12.923800 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-51565cf8-8b4b-4025-9f87-33d77a9d744d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:12.925123 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-51565cf8-8b4b-4025-9f87-33d77a9d744d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:12.925898 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-51565cf8-8b4b-4025-9f87-33d77a9d744d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:13.070302 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-51565cf8-8b4b-4025-9f87-33d77a9d744d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:13.087076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-51565cf8-8b4b-4025-9f87-33d77a9d744d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:13.088717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-51565cf8-8b4b-4025-9f87-33d77a9d744d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:13.089930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-51565cf8-8b4b-4025-9f87-33d77a9d744d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.180277 Oct 28 08:45:13.090497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 434/809] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:12 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:13.790106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ea1a5005-bf26-46fd-834d-28807ebd7c0f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:13.790706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ea1a5005-bf26-46fd-834d-28807ebd7c0f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:13.797398 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ea1a5005-bf26-46fd-834d-28807ebd7c0f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:13.797875 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ea1a5005-bf26-46fd-834d-28807ebd7c0f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:13.798643 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ea1a5005-bf26-46fd-834d-28807ebd7c0f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:13.799072 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ea1a5005-bf26-46fd-834d-28807ebd7c0f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:13.931142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ea1a5005-bf26-46fd-834d-28807ebd7c0f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:13.940392 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ea1a5005-bf26-46fd-834d-28807ebd7c0f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.153967 Oct 28 08:45:13.940902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 376/810] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:13 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:14.108625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5e1e06e4-9d32-40d2-854b-4047720f07fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:14.109205 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5e1e06e4-9d32-40d2-854b-4047720f07fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:14.115621 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5e1e06e4-9d32-40d2-854b-4047720f07fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:14.116122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5e1e06e4-9d32-40d2-854b-4047720f07fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:14.116972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5e1e06e4-9d32-40d2-854b-4047720f07fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:14.117402 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5e1e06e4-9d32-40d2-854b-4047720f07fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:14.246973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5e1e06e4-9d32-40d2-854b-4047720f07fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:14.254551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5e1e06e4-9d32-40d2-854b-4047720f07fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:14.256033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5e1e06e4-9d32-40d2-854b-4047720f07fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:14.257177 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5e1e06e4-9d32-40d2-854b-4047720f07fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.152280 Oct 28 08:45:14.257734 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 435/811] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:14 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:14.957606 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2fea5d20-a21f-4e48-83f9-7bfb635b5781 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:14.958195 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2fea5d20-a21f-4e48-83f9-7bfb635b5781 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:14.964588 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2fea5d20-a21f-4e48-83f9-7bfb635b5781 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:14.965028 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2fea5d20-a21f-4e48-83f9-7bfb635b5781 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:14.965804 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2fea5d20-a21f-4e48-83f9-7bfb635b5781 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:14.966241 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2fea5d20-a21f-4e48-83f9-7bfb635b5781 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:15.092891 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2fea5d20-a21f-4e48-83f9-7bfb635b5781 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:15.100911 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2fea5d20-a21f-4e48-83f9-7bfb635b5781 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.147010 Oct 28 08:45:15.101699 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 377/812] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:14 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:15.276187 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-371c46b9-6739-48c1-9963-2a098eff5ba5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:15.277882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-371c46b9-6739-48c1-9963-2a098eff5ba5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:15.286359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-371c46b9-6739-48c1-9963-2a098eff5ba5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:15.286803 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-371c46b9-6739-48c1-9963-2a098eff5ba5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:15.287577 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-371c46b9-6739-48c1-9963-2a098eff5ba5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:15.288009 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-371c46b9-6739-48c1-9963-2a098eff5ba5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:15.412794 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-371c46b9-6739-48c1-9963-2a098eff5ba5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:15.421852 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-371c46b9-6739-48c1-9963-2a098eff5ba5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:15.423469 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-371c46b9-6739-48c1-9963-2a098eff5ba5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:15.424670 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-371c46b9-6739-48c1-9963-2a098eff5ba5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.152451 Oct 28 08:45:15.425252 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 436/813] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:15 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:16.119991 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d458365c-dee8-4d06-ab84-898f1a46eb88 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:16.119991 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d458365c-dee8-4d06-ab84-898f1a46eb88 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:16.127504 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d458365c-dee8-4d06-ab84-898f1a46eb88 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:16.127944 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d458365c-dee8-4d06-ab84-898f1a46eb88 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:16.128742 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d458365c-dee8-4d06-ab84-898f1a46eb88 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:16.129177 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d458365c-dee8-4d06-ab84-898f1a46eb88 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:16.258115 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d458365c-dee8-4d06-ab84-898f1a46eb88 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:16.266834 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d458365c-dee8-4d06-ab84-898f1a46eb88 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.151346 Oct 28 08:45:16.267426 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 378/814] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:16 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:16.443250 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-04ac5264-6223-47df-bfad-a1a01696cc37 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:16.443838 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-04ac5264-6223-47df-bfad-a1a01696cc37 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:16.451111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04ac5264-6223-47df-bfad-a1a01696cc37 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:16.451550 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04ac5264-6223-47df-bfad-a1a01696cc37 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:16.452313 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04ac5264-6223-47df-bfad-a1a01696cc37 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:16.452735 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04ac5264-6223-47df-bfad-a1a01696cc37 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:16.582912 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-04ac5264-6223-47df-bfad-a1a01696cc37 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:16.592334 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-04ac5264-6223-47df-bfad-a1a01696cc37 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:16.593920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-04ac5264-6223-47df-bfad-a1a01696cc37 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:16.595132 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-04ac5264-6223-47df-bfad-a1a01696cc37 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.156069 Oct 28 08:45:16.595719 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 437/815] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:16 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:17.284540 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-50046ab6-b9be-4b62-a4b5-61a046a77be4 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:17.285126 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-50046ab6-b9be-4b62-a4b5-61a046a77be4 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:17.292085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50046ab6-b9be-4b62-a4b5-61a046a77be4 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:17.292528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50046ab6-b9be-4b62-a4b5-61a046a77be4 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:17.293322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50046ab6-b9be-4b62-a4b5-61a046a77be4 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:17.293750 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-50046ab6-b9be-4b62-a4b5-61a046a77be4 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:17.432050 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-50046ab6-b9be-4b62-a4b5-61a046a77be4 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:17.440820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-50046ab6-b9be-4b62-a4b5-61a046a77be4 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.159821 Oct 28 08:45:17.441674 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 379/816] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:17 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:17.614996 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a8ca91eb-baa9-4afe-b2bb-25f5b631b175 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:17.615793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a8ca91eb-baa9-4afe-b2bb-25f5b631b175 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:17.622835 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a8ca91eb-baa9-4afe-b2bb-25f5b631b175 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:17.623279 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a8ca91eb-baa9-4afe-b2bb-25f5b631b175 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:17.624054 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a8ca91eb-baa9-4afe-b2bb-25f5b631b175 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:17.624480 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a8ca91eb-baa9-4afe-b2bb-25f5b631b175 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:17.759289 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a8ca91eb-baa9-4afe-b2bb-25f5b631b175 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:17.768192 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a8ca91eb-baa9-4afe-b2bb-25f5b631b175 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:17.769682 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a8ca91eb-baa9-4afe-b2bb-25f5b631b175 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:17.770876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a8ca91eb-baa9-4afe-b2bb-25f5b631b175 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.159737 Oct 28 08:45:17.771435 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 438/817] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:17 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:18.459473 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3e2a3d4c-c62c-4a20-a260-0d132e1e049a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:18.460325 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3e2a3d4c-c62c-4a20-a260-0d132e1e049a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:18.468001 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e2a3d4c-c62c-4a20-a260-0d132e1e049a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:18.468467 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e2a3d4c-c62c-4a20-a260-0d132e1e049a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:18.469329 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e2a3d4c-c62c-4a20-a260-0d132e1e049a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:18.469762 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3e2a3d4c-c62c-4a20-a260-0d132e1e049a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:18.612434 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3e2a3d4c-c62c-4a20-a260-0d132e1e049a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:18.620850 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3e2a3d4c-c62c-4a20-a260-0d132e1e049a tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.165377 Oct 28 08:45:18.621414 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 380/818] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:18 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:18.790226 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-be1a900e-7ae3-47e1-bd12-2d0ecee1e881 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:18.790832 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-be1a900e-7ae3-47e1-bd12-2d0ecee1e881 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:18.798111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be1a900e-7ae3-47e1-bd12-2d0ecee1e881 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:18.798553 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be1a900e-7ae3-47e1-bd12-2d0ecee1e881 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:18.799338 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be1a900e-7ae3-47e1-bd12-2d0ecee1e881 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:18.799978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be1a900e-7ae3-47e1-bd12-2d0ecee1e881 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:18.925689 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-be1a900e-7ae3-47e1-bd12-2d0ecee1e881 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:18.934006 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-be1a900e-7ae3-47e1-bd12-2d0ecee1e881 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:18.935495 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-be1a900e-7ae3-47e1-bd12-2d0ecee1e881 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:18.936769 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-be1a900e-7ae3-47e1-bd12-2d0ecee1e881 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1742 microversion: 2.20 time: 0.150312 Oct 28 08:45:18.937386 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 439/819] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:18 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:19.640409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3f10ccb4-f8a9-4cf7-9ecd-e38c3727e770 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:19.640969 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3f10ccb4-f8a9-4cf7-9ecd-e38c3727e770 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:19.647277 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f10ccb4-f8a9-4cf7-9ecd-e38c3727e770 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:19.647719 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f10ccb4-f8a9-4cf7-9ecd-e38c3727e770 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:19.648479 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f10ccb4-f8a9-4cf7-9ecd-e38c3727e770 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:19.648911 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f10ccb4-f8a9-4cf7-9ecd-e38c3727e770 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:19.790135 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3f10ccb4-f8a9-4cf7-9ecd-e38c3727e770 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:19.798031 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3f10ccb4-f8a9-4cf7-9ecd-e38c3727e770 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.161290 Oct 28 08:45:19.798597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 381/820] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:19 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:19.956017 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1ad85879-36f8-48d7-83b4-456c36835eec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:19.956556 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1ad85879-36f8-48d7-83b4-456c36835eec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:19.962813 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ad85879-36f8-48d7-83b4-456c36835eec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:19.963880 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ad85879-36f8-48d7-83b4-456c36835eec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:19.964637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ad85879-36f8-48d7-83b4-456c36835eec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:19.965066 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ad85879-36f8-48d7-83b4-456c36835eec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:20.090597 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-1ad85879-36f8-48d7-83b4-456c36835eec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:20.098517 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-1ad85879-36f8-48d7-83b4-456c36835eec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:20.100009 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-1ad85879-36f8-48d7-83b4-456c36835eec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:20.101195 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1ad85879-36f8-48d7-83b4-456c36835eec tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1742 microversion: 2.20 time: 0.148993 Oct 28 08:45:20.101758 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 440/821] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:19 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1742 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:20.814572 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5ad9d256-fc04-4428-a98a-652e0b020968 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:20.815216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5ad9d256-fc04-4428-a98a-652e0b020968 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:20.821474 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5ad9d256-fc04-4428-a98a-652e0b020968 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:20.821946 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5ad9d256-fc04-4428-a98a-652e0b020968 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:20.823208 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5ad9d256-fc04-4428-a98a-652e0b020968 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:20.823964 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5ad9d256-fc04-4428-a98a-652e0b020968 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:20.956468 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5ad9d256-fc04-4428-a98a-652e0b020968 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:20.964389 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5ad9d256-fc04-4428-a98a-652e0b020968 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.153434 Oct 28 08:45:20.965014 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 382/822] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:20 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:21.119203 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6ec26726-75cc-4485-98af-c786dc68337f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:21.119784 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6ec26726-75cc-4485-98af-c786dc68337f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:21.127368 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6ec26726-75cc-4485-98af-c786dc68337f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:21.127817 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6ec26726-75cc-4485-98af-c786dc68337f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:21.128608 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6ec26726-75cc-4485-98af-c786dc68337f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:21.129041 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6ec26726-75cc-4485-98af-c786dc68337f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:21.257837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6ec26726-75cc-4485-98af-c786dc68337f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:21.265584 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6ec26726-75cc-4485-98af-c786dc68337f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:21.267125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6ec26726-75cc-4485-98af-c786dc68337f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:21.268280 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6ec26726-75cc-4485-98af-c786dc68337f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1742 microversion: 2.20 time: 0.152828 Oct 28 08:45:21.268840 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 441/823] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:21 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:21.982051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d1f3c215-2006-4318-8a34-0548aa5e7536 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:21.982668 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d1f3c215-2006-4318-8a34-0548aa5e7536 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:21.989057 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d1f3c215-2006-4318-8a34-0548aa5e7536 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:21.989501 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d1f3c215-2006-4318-8a34-0548aa5e7536 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:21.990306 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d1f3c215-2006-4318-8a34-0548aa5e7536 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:21.990739 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d1f3c215-2006-4318-8a34-0548aa5e7536 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:22.129100 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d1f3c215-2006-4318-8a34-0548aa5e7536 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:22.137102 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d1f3c215-2006-4318-8a34-0548aa5e7536 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.159262 Oct 28 08:45:22.137677 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 383/824] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:21 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:22.286741 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6e373374-2df1-431e-b715-1ea29edfbb77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:22.287381 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6e373374-2df1-431e-b715-1ea29edfbb77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:22.294160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6e373374-2df1-431e-b715-1ea29edfbb77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:22.294605 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6e373374-2df1-431e-b715-1ea29edfbb77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:22.295367 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6e373374-2df1-431e-b715-1ea29edfbb77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:22.295797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6e373374-2df1-431e-b715-1ea29edfbb77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:22.421189 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6e373374-2df1-431e-b715-1ea29edfbb77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:22.429270 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6e373374-2df1-431e-b715-1ea29edfbb77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:22.430981 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6e373374-2df1-431e-b715-1ea29edfbb77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:22.432876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6e373374-2df1-431e-b715-1ea29edfbb77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1742 microversion: 2.20 time: 0.149267 Oct 28 08:45:22.433841 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 442/825] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:22 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1742 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:23.155311 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8673bd9e-997e-4753-af52-6eafb399ecb0 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:23.155896 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8673bd9e-997e-4753-af52-6eafb399ecb0 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:23.162684 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8673bd9e-997e-4753-af52-6eafb399ecb0 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:23.163132 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8673bd9e-997e-4753-af52-6eafb399ecb0 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:23.163929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8673bd9e-997e-4753-af52-6eafb399ecb0 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:23.164373 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8673bd9e-997e-4753-af52-6eafb399ecb0 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:23.297370 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8673bd9e-997e-4753-af52-6eafb399ecb0 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:23.305154 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8673bd9e-997e-4753-af52-6eafb399ecb0 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.154363 Oct 28 08:45:23.305720 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 384/826] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:23 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:23.452510 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-36b3752d-a4cb-406a-b4c1-d624259f77bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:23.453156 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-36b3752d-a4cb-406a-b4c1-d624259f77bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:23.459243 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36b3752d-a4cb-406a-b4c1-d624259f77bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:23.459693 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36b3752d-a4cb-406a-b4c1-d624259f77bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:23.460457 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36b3752d-a4cb-406a-b4c1-d624259f77bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:23.460893 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-36b3752d-a4cb-406a-b4c1-d624259f77bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:23.591802 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-36b3752d-a4cb-406a-b4c1-d624259f77bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:23.599583 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-36b3752d-a4cb-406a-b4c1-d624259f77bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:23.601117 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-36b3752d-a4cb-406a-b4c1-d624259f77bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:23.602315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-36b3752d-a4cb-406a-b4c1-d624259f77bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1742 microversion: 2.20 time: 0.153618 Oct 28 08:45:23.602876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 443/827] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:23 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:24.324670 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-26b55743-2cf4-4f3e-9fd1-d4896e35a1eb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:24.325276 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-26b55743-2cf4-4f3e-9fd1-d4896e35a1eb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:24.335955 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-26b55743-2cf4-4f3e-9fd1-d4896e35a1eb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:24.336394 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-26b55743-2cf4-4f3e-9fd1-d4896e35a1eb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:24.337157 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-26b55743-2cf4-4f3e-9fd1-d4896e35a1eb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:24.337588 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-26b55743-2cf4-4f3e-9fd1-d4896e35a1eb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:24.478263 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-26b55743-2cf4-4f3e-9fd1-d4896e35a1eb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:24.486375 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-26b55743-2cf4-4f3e-9fd1-d4896e35a1eb tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.166802 Oct 28 08:45:24.486980 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 385/828] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:24 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:24.622234 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e09708e8-e9cc-48be-97af-c236b45128e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:24.622812 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e09708e8-e9cc-48be-97af-c236b45128e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:24.629036 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e09708e8-e9cc-48be-97af-c236b45128e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:24.629476 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e09708e8-e9cc-48be-97af-c236b45128e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:24.630268 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e09708e8-e9cc-48be-97af-c236b45128e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:24.630701 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e09708e8-e9cc-48be-97af-c236b45128e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:24.761226 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e09708e8-e9cc-48be-97af-c236b45128e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:24.769314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e09708e8-e9cc-48be-97af-c236b45128e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:24.770922 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e09708e8-e9cc-48be-97af-c236b45128e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:24.772155 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e09708e8-e9cc-48be-97af-c236b45128e7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1742 microversion: 2.20 time: 0.155590 Oct 28 08:45:24.772737 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 444/829] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:24 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:25.503558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f49d0cc0-9cf8-4fe5-9a00-2963e6787f71 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:25.504156 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f49d0cc0-9cf8-4fe5-9a00-2963e6787f71 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:25.510596 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f49d0cc0-9cf8-4fe5-9a00-2963e6787f71 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:25.511157 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f49d0cc0-9cf8-4fe5-9a00-2963e6787f71 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:25.511739 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f49d0cc0-9cf8-4fe5-9a00-2963e6787f71 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:25.512169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f49d0cc0-9cf8-4fe5-9a00-2963e6787f71 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:25.641022 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f49d0cc0-9cf8-4fe5-9a00-2963e6787f71 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:25.649032 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f49d0cc0-9cf8-4fe5-9a00-2963e6787f71 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1756 microversion: 2.1 time: 0.149252 Oct 28 08:45:25.649630 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 386/830] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:25 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1756 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:25.791059 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dbf3d5dd-23bd-4980-9387-469844d53738 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:25.791663 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dbf3d5dd-23bd-4980-9387-469844d53738 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:25.797993 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dbf3d5dd-23bd-4980-9387-469844d53738 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:25.798436 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dbf3d5dd-23bd-4980-9387-469844d53738 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:25.799193 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dbf3d5dd-23bd-4980-9387-469844d53738 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:25.799625 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dbf3d5dd-23bd-4980-9387-469844d53738 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:25.934502 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dbf3d5dd-23bd-4980-9387-469844d53738 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:25.942553 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dbf3d5dd-23bd-4980-9387-469844d53738 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:25.944268 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dbf3d5dd-23bd-4980-9387-469844d53738 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:25.945440 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dbf3d5dd-23bd-4980-9387-469844d53738 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1742 microversion: 2.20 time: 0.158531 Oct 28 08:45:25.946063 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 445/831] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:25 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:26.113621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-bfa0dfdc-fca2-487b-82fc-8a1d8f0e16a5 req-5bf18477-f592-4b13-b936-316b448b8c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423157c3-a1e9-43c5-8fda-01d1d93bd484", "name": "network-vif-plugged", "status": "completed", "tag": "2e8c6f82-a258-4342-aacf-0b4e80ccd12e"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:26.115228 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:45:26.115228 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:45:26.124368 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-bfa0dfdc-fca2-487b-82fc-8a1d8f0e16a5 req-5bf18477-f592-4b13-b936-316b448b8c0f service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:26.124996 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-bfa0dfdc-fca2-487b-82fc-8a1d8f0e16a5 req-5bf18477-f592-4b13-b936-316b448b8c0f service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:26.139793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-bfa0dfdc-fca2-487b-82fc-8a1d8f0e16a5 req-5bf18477-f592-4b13-b936-316b448b8c0f service nova] Creating event network-vif-plugged:2e8c6f82-a258-4342-aacf-0b4e80ccd12e for instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 on hv-cinder-81566 Oct 28 08:45:26.144879 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-bfa0dfdc-fca2-487b-82fc-8a1d8f0e16a5 req-5bf18477-f592-4b13-b936-316b448b8c0f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112642 Oct 28 08:45:26.145487 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 387/832] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:45:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:45:26.668128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ee981a9a-75b2-437d-a6b0-512391dc521b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:26.668736 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ee981a9a-75b2-437d-a6b0-512391dc521b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:26.674765 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ee981a9a-75b2-437d-a6b0-512391dc521b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:26.675204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ee981a9a-75b2-437d-a6b0-512391dc521b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:26.675981 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ee981a9a-75b2-437d-a6b0-512391dc521b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:26.676409 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ee981a9a-75b2-437d-a6b0-512391dc521b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:26.818395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ee981a9a-75b2-437d-a6b0-512391dc521b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:26.826287 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ee981a9a-75b2-437d-a6b0-512391dc521b tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1759 microversion: 2.1 time: 0.162705 Oct 28 08:45:26.826856 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 446/833] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:26 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:26.965747 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6743fe6c-c0f0-4243-adb1-403e67d8acf3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:26.966455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6743fe6c-c0f0-4243-adb1-403e67d8acf3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:26.972814 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6743fe6c-c0f0-4243-adb1-403e67d8acf3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:26.973260 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6743fe6c-c0f0-4243-adb1-403e67d8acf3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:26.974044 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6743fe6c-c0f0-4243-adb1-403e67d8acf3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:26.974471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6743fe6c-c0f0-4243-adb1-403e67d8acf3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:27.101769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6743fe6c-c0f0-4243-adb1-403e67d8acf3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:27.110900 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6743fe6c-c0f0-4243-adb1-403e67d8acf3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:27.113101 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6743fe6c-c0f0-4243-adb1-403e67d8acf3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:27.113687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6743fe6c-c0f0-4243-adb1-403e67d8acf3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1742 microversion: 2.20 time: 0.152681 Oct 28 08:45:27.114369 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 388/834] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:26 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:28.132255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-310ba375-c698-46e2-aad4-a51c4fb9a2fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:28.132896 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-310ba375-c698-46e2-aad4-a51c4fb9a2fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:28.140176 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-310ba375-c698-46e2-aad4-a51c4fb9a2fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:28.140614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-310ba375-c698-46e2-aad4-a51c4fb9a2fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:28.141421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-310ba375-c698-46e2-aad4-a51c4fb9a2fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:28.141900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-310ba375-c698-46e2-aad4-a51c4fb9a2fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:28.275707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-310ba375-c698-46e2-aad4-a51c4fb9a2fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:28.285760 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-310ba375-c698-46e2-aad4-a51c4fb9a2fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:28.287542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-310ba375-c698-46e2-aad4-a51c4fb9a2fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:28.288978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-310ba375-c698-46e2-aad4-a51c4fb9a2fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.160654 Oct 28 08:45:28.289743 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 447/835] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:28 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:29.309072 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2720465f-c2f3-4927-9a38-5e09fda354b2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:29.309615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2720465f-c2f3-4927-9a38-5e09fda354b2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:29.316242 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2720465f-c2f3-4927-9a38-5e09fda354b2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:29.316688 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2720465f-c2f3-4927-9a38-5e09fda354b2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:29.317468 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2720465f-c2f3-4927-9a38-5e09fda354b2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:29.317932 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2720465f-c2f3-4927-9a38-5e09fda354b2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:29.450196 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2720465f-c2f3-4927-9a38-5e09fda354b2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:29.458598 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2720465f-c2f3-4927-9a38-5e09fda354b2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:29.460095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2720465f-c2f3-4927-9a38-5e09fda354b2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:29.461248 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2720465f-c2f3-4927-9a38-5e09fda354b2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.156089 Oct 28 08:45:29.461830 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 389/836] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:29 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:30.481238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-69934a10-7add-479a-b331-5734cd3ab0df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:30.482126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-69934a10-7add-479a-b331-5734cd3ab0df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:30.488488 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69934a10-7add-479a-b331-5734cd3ab0df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:30.488945 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69934a10-7add-479a-b331-5734cd3ab0df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:30.490453 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69934a10-7add-479a-b331-5734cd3ab0df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:30.490891 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-69934a10-7add-479a-b331-5734cd3ab0df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:30.632496 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-69934a10-7add-479a-b331-5734cd3ab0df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:30.641935 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-69934a10-7add-479a-b331-5734cd3ab0df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:30.643971 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-69934a10-7add-479a-b331-5734cd3ab0df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:30.646175 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-69934a10-7add-479a-b331-5734cd3ab0df tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.169661 Oct 28 08:45:30.646768 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 448/837] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:30 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:31.664858 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6a1bea9f-4fc6-4bc6-8259-a6f65aba6ab5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:31.666454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6a1bea9f-4fc6-4bc6-8259-a6f65aba6ab5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:31.673522 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6a1bea9f-4fc6-4bc6-8259-a6f65aba6ab5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:31.674268 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6a1bea9f-4fc6-4bc6-8259-a6f65aba6ab5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:31.675059 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6a1bea9f-4fc6-4bc6-8259-a6f65aba6ab5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:31.675496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6a1bea9f-4fc6-4bc6-8259-a6f65aba6ab5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:31.814875 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6a1bea9f-4fc6-4bc6-8259-a6f65aba6ab5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:31.823992 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6a1bea9f-4fc6-4bc6-8259-a6f65aba6ab5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:31.825508 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6a1bea9f-4fc6-4bc6-8259-a6f65aba6ab5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:31.826706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6a1bea9f-4fc6-4bc6-8259-a6f65aba6ab5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.166158 Oct 28 08:45:31.827263 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 390/838] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:31 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:32.847897 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a310a89c-94fa-4fc1-997c-2105c1a0ad11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:32.848931 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a310a89c-94fa-4fc1-997c-2105c1a0ad11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:32.867985 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a310a89c-94fa-4fc1-997c-2105c1a0ad11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:32.869137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a310a89c-94fa-4fc1-997c-2105c1a0ad11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:32.870723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a310a89c-94fa-4fc1-997c-2105c1a0ad11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:32.871687 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a310a89c-94fa-4fc1-997c-2105c1a0ad11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:33.050455 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a310a89c-94fa-4fc1-997c-2105c1a0ad11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:33.059649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a310a89c-94fa-4fc1-997c-2105c1a0ad11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:33.061085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a310a89c-94fa-4fc1-997c-2105c1a0ad11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:33.062295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a310a89c-94fa-4fc1-997c-2105c1a0ad11 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.220399 Oct 28 08:45:33.062854 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 449/839] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:32 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:34.080377 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-29392da8-a722-4dae-85c5-c44538a38848 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:34.081943 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-29392da8-a722-4dae-85c5-c44538a38848 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:34.089629 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-29392da8-a722-4dae-85c5-c44538a38848 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:34.090240 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-29392da8-a722-4dae-85c5-c44538a38848 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:34.091323 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-29392da8-a722-4dae-85c5-c44538a38848 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:34.092030 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-29392da8-a722-4dae-85c5-c44538a38848 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:34.248432 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-29392da8-a722-4dae-85c5-c44538a38848 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:34.258023 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-29392da8-a722-4dae-85c5-c44538a38848 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:34.259925 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-29392da8-a722-4dae-85c5-c44538a38848 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:34.261983 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-29392da8-a722-4dae-85c5-c44538a38848 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.185289 Oct 28 08:45:34.272758 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 391/840] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:34 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:35.281002 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-93984d27-7ca2-4f3f-a004-b3e429198cd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:35.281992 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-93984d27-7ca2-4f3f-a004-b3e429198cd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:35.288420 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-93984d27-7ca2-4f3f-a004-b3e429198cd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:35.288865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-93984d27-7ca2-4f3f-a004-b3e429198cd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:35.289650 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-93984d27-7ca2-4f3f-a004-b3e429198cd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:35.290105 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-93984d27-7ca2-4f3f-a004-b3e429198cd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:35.427938 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-93984d27-7ca2-4f3f-a004-b3e429198cd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:35.436672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-93984d27-7ca2-4f3f-a004-b3e429198cd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:35.438355 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-93984d27-7ca2-4f3f-a004-b3e429198cd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:35.439553 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-93984d27-7ca2-4f3f-a004-b3e429198cd5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.162896 Oct 28 08:45:35.440150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 450/841] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:35 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:36.458910 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f2437535-d2d8-47c1-9f40-8e5a91ab59eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:36.460162 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f2437535-d2d8-47c1-9f40-8e5a91ab59eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:36.466897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2437535-d2d8-47c1-9f40-8e5a91ab59eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:36.467600 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2437535-d2d8-47c1-9f40-8e5a91ab59eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:36.468629 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2437535-d2d8-47c1-9f40-8e5a91ab59eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:36.469138 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2437535-d2d8-47c1-9f40-8e5a91ab59eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:36.614110 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f2437535-d2d8-47c1-9f40-8e5a91ab59eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:36.623067 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f2437535-d2d8-47c1-9f40-8e5a91ab59eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:36.624957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f2437535-d2d8-47c1-9f40-8e5a91ab59eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:36.626615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f2437535-d2d8-47c1-9f40-8e5a91ab59eb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.171460 Oct 28 08:45:36.627251 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 392/842] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:36 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:37.645282 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fd53f788-0435-46dc-a7d0-eff687b1e4ef tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:37.646161 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fd53f788-0435-46dc-a7d0-eff687b1e4ef tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:37.653488 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd53f788-0435-46dc-a7d0-eff687b1e4ef tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:37.654227 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd53f788-0435-46dc-a7d0-eff687b1e4ef tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:37.655267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd53f788-0435-46dc-a7d0-eff687b1e4ef tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:37.655763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd53f788-0435-46dc-a7d0-eff687b1e4ef tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:37.804371 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fd53f788-0435-46dc-a7d0-eff687b1e4ef tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:37.817468 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fd53f788-0435-46dc-a7d0-eff687b1e4ef tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:37.820339 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fd53f788-0435-46dc-a7d0-eff687b1e4ef tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:37.821888 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fd53f788-0435-46dc-a7d0-eff687b1e4ef tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.180279 Oct 28 08:45:37.822881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 451/843] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:37 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:38.841210 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d62d9737-0f09-4843-a682-b75aa8068cea tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:38.841981 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d62d9737-0f09-4843-a682-b75aa8068cea tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:38.848364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d62d9737-0f09-4843-a682-b75aa8068cea tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:38.848962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d62d9737-0f09-4843-a682-b75aa8068cea tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:38.849963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d62d9737-0f09-4843-a682-b75aa8068cea tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:38.850364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d62d9737-0f09-4843-a682-b75aa8068cea tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:39.000723 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d62d9737-0f09-4843-a682-b75aa8068cea tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:39.009957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d62d9737-0f09-4843-a682-b75aa8068cea tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:39.011520 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d62d9737-0f09-4843-a682-b75aa8068cea tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:39.012692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d62d9737-0f09-4843-a682-b75aa8068cea tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.175861 Oct 28 08:45:39.013250 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 393/844] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:38 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:40.032612 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a27d1095-426f-4d23-b1ba-bf1856ecef13 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:40.033236 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a27d1095-426f-4d23-b1ba-bf1856ecef13 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:40.039083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a27d1095-426f-4d23-b1ba-bf1856ecef13 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:40.039526 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a27d1095-426f-4d23-b1ba-bf1856ecef13 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:40.040296 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a27d1095-426f-4d23-b1ba-bf1856ecef13 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:40.040726 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a27d1095-426f-4d23-b1ba-bf1856ecef13 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:40.165425 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a27d1095-426f-4d23-b1ba-bf1856ecef13 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:40.173726 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a27d1095-426f-4d23-b1ba-bf1856ecef13 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:40.175256 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a27d1095-426f-4d23-b1ba-bf1856ecef13 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:40.176413 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a27d1095-426f-4d23-b1ba-bf1856ecef13 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1737 microversion: 2.20 time: 0.147779 Oct 28 08:45:40.177005 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 452/845] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:40 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:41.195607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e73b5842-33dd-43fb-b897-ee91184426dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:41.196219 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e73b5842-33dd-43fb-b897-ee91184426dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:41.203786 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e73b5842-33dd-43fb-b897-ee91184426dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:41.204236 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e73b5842-33dd-43fb-b897-ee91184426dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:41.205086 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e73b5842-33dd-43fb-b897-ee91184426dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:41.205531 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e73b5842-33dd-43fb-b897-ee91184426dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:41.389266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e73b5842-33dd-43fb-b897-ee91184426dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:41.397505 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e73b5842-33dd-43fb-b897-ee91184426dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:41.399037 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e73b5842-33dd-43fb-b897-ee91184426dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:41.400185 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e73b5842-33dd-43fb-b897-ee91184426dd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1719 microversion: 2.20 time: 0.208684 Oct 28 08:45:41.400982 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 394/846] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:41 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1719 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:42.418469 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5d3a2fba-4d40-453c-a134-10d22cc3d52a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:42.419091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5d3a2fba-4d40-453c-a134-10d22cc3d52a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:42.425910 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5d3a2fba-4d40-453c-a134-10d22cc3d52a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:42.426359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5d3a2fba-4d40-453c-a134-10d22cc3d52a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:42.427148 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5d3a2fba-4d40-453c-a134-10d22cc3d52a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:42.427583 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5d3a2fba-4d40-453c-a134-10d22cc3d52a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:42.553740 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5d3a2fba-4d40-453c-a134-10d22cc3d52a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:42.561486 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5d3a2fba-4d40-453c-a134-10d22cc3d52a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:42.563001 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5d3a2fba-4d40-453c-a134-10d22cc3d52a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:42.564192 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5d3a2fba-4d40-453c-a134-10d22cc3d52a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1719 microversion: 2.20 time: 0.149744 Oct 28 08:45:42.564751 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 453/847] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:42 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:43.583110 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5ad386ec-f1b2-4792-bf53-7a513f5b0109 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:43.583703 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5ad386ec-f1b2-4792-bf53-7a513f5b0109 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:43.590889 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5ad386ec-f1b2-4792-bf53-7a513f5b0109 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:43.591339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5ad386ec-f1b2-4792-bf53-7a513f5b0109 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:43.592105 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5ad386ec-f1b2-4792-bf53-7a513f5b0109 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:43.592538 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5ad386ec-f1b2-4792-bf53-7a513f5b0109 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:43.721092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5ad386ec-f1b2-4792-bf53-7a513f5b0109 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:43.729471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5ad386ec-f1b2-4792-bf53-7a513f5b0109 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:43.731281 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5ad386ec-f1b2-4792-bf53-7a513f5b0109 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:43.732485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5ad386ec-f1b2-4792-bf53-7a513f5b0109 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1722 microversion: 2.20 time: 0.153432 Oct 28 08:45:43.733059 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 395/848] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:43 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:43.750153 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-97b1b9b6-733d-4eb0-adb5-670cba39e6b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57e1f258-d991-4b61-b030-4914b4cfaada"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:43.751199 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-97b1b9b6-733d-4eb0-adb5-670cba39e6b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:43.757678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97b1b9b6-733d-4eb0-adb5-670cba39e6b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:43.758152 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97b1b9b6-733d-4eb0-adb5-670cba39e6b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:43.758912 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97b1b9b6-733d-4eb0-adb5-670cba39e6b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:43.759341 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97b1b9b6-733d-4eb0-adb5-670cba39e6b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:44.063917 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-de3de52f-a9eb-455e-89ff-acc87763f2c4 req-d3e5a941-5336-470a-8658-39de6c502b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423157c3-a1e9-43c5-8fda-01d1d93bd484", "name": "network-vif-unplugged", "status": "completed", "tag": "2e8c6f82-a258-4342-aacf-0b4e80ccd12e"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:44.066791 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:45:44.066791 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:45:44.077807 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-de3de52f-a9eb-455e-89ff-acc87763f2c4 req-d3e5a941-5336-470a-8658-39de6c502b6d service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:44.078401 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-de3de52f-a9eb-455e-89ff-acc87763f2c4 req-d3e5a941-5336-470a-8658-39de6c502b6d service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:44.082644 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-97b1b9b6-733d-4eb0-adb5-670cba39e6b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335903 Oct 28 08:45:44.085846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 454/849] 10.222.0.74 () {62 vars in 1363 bytes} [Thu Oct 28 08:45:43 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-volume_attachments => generated 188 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:45:44.100985 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.compute.server_external_events [req-de3de52f-a9eb-455e-89ff-acc87763f2c4 req-d3e5a941-5336-470a-8658-39de6c502b6d service nova] Unable to find a host for instance 423157c3-a1e9-43c5-8fda-01d1d93bd484. Dropping event network-vif-unplugged {{(pid=132796) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 28 08:45:44.104650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-de3de52f-a9eb-455e-89ff-acc87763f2c4 req-d3e5a941-5336-470a-8658-39de6c502b6d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047034 Oct 28 08:45:44.107022 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 396/850] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:45:44 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 08:45:44.212214 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8c77a694-651c-4544-be9f-a54578e70237 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:44.212781 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8c77a694-651c-4544-be9f-a54578e70237 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:44.219562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8c77a694-651c-4544-be9f-a54578e70237 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:44.220035 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8c77a694-651c-4544-be9f-a54578e70237 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:44.220811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8c77a694-651c-4544-be9f-a54578e70237 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:44.221240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8c77a694-651c-4544-be9f-a54578e70237 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:44.422798 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8c77a694-651c-4544-be9f-a54578e70237 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action" status: 202 len: 0 microversion: 2.20 time: 0.213737 Oct 28 08:45:44.426429 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 455/851] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:45:44 2021] POST /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:45:44.431772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-08b6a1d8-b4fd-4d0d-85ac-b7e87a73d744 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:44.437178 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-08b6a1d8-b4fd-4d0d-85ac-b7e87a73d744 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:44.443226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-08b6a1d8-b4fd-4d0d-85ac-b7e87a73d744 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:44.443673 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-08b6a1d8-b4fd-4d0d-85ac-b7e87a73d744 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:44.444438 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-08b6a1d8-b4fd-4d0d-85ac-b7e87a73d744 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:44.444864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-08b6a1d8-b4fd-4d0d-85ac-b7e87a73d744 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:44.583291 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-08b6a1d8-b4fd-4d0d-85ac-b7e87a73d744 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:44.592796 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-08b6a1d8-b4fd-4d0d-85ac-b7e87a73d744 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:44.594327 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-08b6a1d8-b4fd-4d0d-85ac-b7e87a73d744 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:44.595679 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-08b6a1d8-b4fd-4d0d-85ac-b7e87a73d744 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1748 microversion: 2.20 time: 0.167881 Oct 28 08:45:44.596244 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 397/852] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:44 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:45.614355 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-688a3a23-e499-4b73-bc63-4be7cc090612 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:45.614999 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-688a3a23-e499-4b73-bc63-4be7cc090612 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:45.621457 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-688a3a23-e499-4b73-bc63-4be7cc090612 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:45.622007 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-688a3a23-e499-4b73-bc63-4be7cc090612 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:45.622979 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-688a3a23-e499-4b73-bc63-4be7cc090612 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:45.623563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-688a3a23-e499-4b73-bc63-4be7cc090612 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:45.765953 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-688a3a23-e499-4b73-bc63-4be7cc090612 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:45.780255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-688a3a23-e499-4b73-bc63-4be7cc090612 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:45.781731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-688a3a23-e499-4b73-bc63-4be7cc090612 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:45.782999 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-688a3a23-e499-4b73-bc63-4be7cc090612 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1750 microversion: 2.20 time: 0.173036 Oct 28 08:45:45.783600 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 456/853] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:45 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:46.804268 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e2429bf6-d87e-4d88-a4c9-65df983d139c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:46.805121 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e2429bf6-d87e-4d88-a4c9-65df983d139c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:46.813865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2429bf6-d87e-4d88-a4c9-65df983d139c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:46.814535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2429bf6-d87e-4d88-a4c9-65df983d139c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:46.815528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2429bf6-d87e-4d88-a4c9-65df983d139c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:46.816077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2429bf6-d87e-4d88-a4c9-65df983d139c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:46.983672 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e2429bf6-d87e-4d88-a4c9-65df983d139c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:46.992027 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e2429bf6-d87e-4d88-a4c9-65df983d139c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:46.993514 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e2429bf6-d87e-4d88-a4c9-65df983d139c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:46.996012 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e2429bf6-d87e-4d88-a4c9-65df983d139c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.195009 Oct 28 08:45:46.996583 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 398/854] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:46 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:48.024406 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-094edb61-dbf2-4bec-a0f8-556a6bfbe2b6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:48.025065 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-094edb61-dbf2-4bec-a0f8-556a6bfbe2b6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:48.040660 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-094edb61-dbf2-4bec-a0f8-556a6bfbe2b6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:48.041350 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-094edb61-dbf2-4bec-a0f8-556a6bfbe2b6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:48.042612 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-094edb61-dbf2-4bec-a0f8-556a6bfbe2b6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:48.043208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-094edb61-dbf2-4bec-a0f8-556a6bfbe2b6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:48.219768 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-094edb61-dbf2-4bec-a0f8-556a6bfbe2b6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:48.230284 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-094edb61-dbf2-4bec-a0f8-556a6bfbe2b6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:48.232724 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-094edb61-dbf2-4bec-a0f8-556a6bfbe2b6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:48.234427 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-094edb61-dbf2-4bec-a0f8-556a6bfbe2b6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.213987 Oct 28 08:45:48.236071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 457/855] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:48 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:49.254620 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-386106c2-4484-4fe1-b52b-26b91acec26c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:49.255380 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-386106c2-4484-4fe1-b52b-26b91acec26c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:49.263160 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-386106c2-4484-4fe1-b52b-26b91acec26c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:49.263600 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-386106c2-4484-4fe1-b52b-26b91acec26c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:49.264637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-386106c2-4484-4fe1-b52b-26b91acec26c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:49.265358 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-386106c2-4484-4fe1-b52b-26b91acec26c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:49.405411 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-386106c2-4484-4fe1-b52b-26b91acec26c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:49.413950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-386106c2-4484-4fe1-b52b-26b91acec26c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:49.415518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-386106c2-4484-4fe1-b52b-26b91acec26c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:49.417343 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-386106c2-4484-4fe1-b52b-26b91acec26c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.165856 Oct 28 08:45:49.418141 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 399/856] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:49 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:50.438348 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e243c8f9-39e5-4c78-b135-5793b025d833 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:50.439099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e243c8f9-39e5-4c78-b135-5793b025d833 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:50.445958 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e243c8f9-39e5-4c78-b135-5793b025d833 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:50.446555 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e243c8f9-39e5-4c78-b135-5793b025d833 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:50.447352 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e243c8f9-39e5-4c78-b135-5793b025d833 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:50.448275 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e243c8f9-39e5-4c78-b135-5793b025d833 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:50.593228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e243c8f9-39e5-4c78-b135-5793b025d833 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:50.602121 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e243c8f9-39e5-4c78-b135-5793b025d833 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:50.603652 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e243c8f9-39e5-4c78-b135-5793b025d833 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:50.604878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e243c8f9-39e5-4c78-b135-5793b025d833 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.171563 Oct 28 08:45:50.605656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 458/857] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:50 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:51.624074 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-93d67f38-ebec-4dcb-be52-89418ebd49d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:51.625387 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-93d67f38-ebec-4dcb-be52-89418ebd49d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:51.632404 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93d67f38-ebec-4dcb-be52-89418ebd49d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:51.632971 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93d67f38-ebec-4dcb-be52-89418ebd49d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:51.634022 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93d67f38-ebec-4dcb-be52-89418ebd49d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:51.634555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93d67f38-ebec-4dcb-be52-89418ebd49d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:51.765384 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-93d67f38-ebec-4dcb-be52-89418ebd49d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:51.775563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-93d67f38-ebec-4dcb-be52-89418ebd49d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:51.778042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-93d67f38-ebec-4dcb-be52-89418ebd49d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:51.779465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-93d67f38-ebec-4dcb-be52-89418ebd49d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.159472 Oct 28 08:45:51.780239 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 400/858] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:51 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:52.802437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-538a3bc5-a00e-4ca2-ad26-7a1a221e15cb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:52.804485 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-538a3bc5-a00e-4ca2-ad26-7a1a221e15cb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:52.823946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-538a3bc5-a00e-4ca2-ad26-7a1a221e15cb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:52.824393 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-538a3bc5-a00e-4ca2-ad26-7a1a221e15cb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:52.825586 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-538a3bc5-a00e-4ca2-ad26-7a1a221e15cb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:52.825586 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-538a3bc5-a00e-4ca2-ad26-7a1a221e15cb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:52.956434 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-538a3bc5-a00e-4ca2-ad26-7a1a221e15cb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:52.965299 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-538a3bc5-a00e-4ca2-ad26-7a1a221e15cb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:52.966984 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-538a3bc5-a00e-4ca2-ad26-7a1a221e15cb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:52.968174 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-538a3bc5-a00e-4ca2-ad26-7a1a221e15cb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.172116 Oct 28 08:45:52.968737 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 459/859] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:52 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:53.987646 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-aaa1c553-a334-43cd-b426-dfc720802888 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:53.988226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-aaa1c553-a334-43cd-b426-dfc720802888 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:53.994589 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aaa1c553-a334-43cd-b426-dfc720802888 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:53.995096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aaa1c553-a334-43cd-b426-dfc720802888 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:53.995863 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aaa1c553-a334-43cd-b426-dfc720802888 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:53.996298 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aaa1c553-a334-43cd-b426-dfc720802888 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:54.140913 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aaa1c553-a334-43cd-b426-dfc720802888 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:54.149075 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aaa1c553-a334-43cd-b426-dfc720802888 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:54.150596 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aaa1c553-a334-43cd-b426-dfc720802888 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:54.152697 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-aaa1c553-a334-43cd-b426-dfc720802888 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.168844 Oct 28 08:45:54.153273 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 401/860] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:53 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:54.750214 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7a0c1ac2-8695-4124-9ce5-b1c5b623d996 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:54.750976 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7a0c1ac2-8695-4124-9ce5-b1c5b623d996 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:54.756687 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a0c1ac2-8695-4124-9ce5-b1c5b623d996 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:54.757208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a0c1ac2-8695-4124-9ce5-b1c5b623d996 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:54.758091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a0c1ac2-8695-4124-9ce5-b1c5b623d996 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:54.758612 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a0c1ac2-8695-4124-9ce5-b1c5b623d996 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:54.842573 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-7a0c1ac2-8695-4124-9ce5-b1c5b623d996 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lazy-loading 'services' on Instance uuid a8d46e50-0675-4d39-9947-f35acce9f945 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:45:54.934365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7a0c1ac2-8695-4124-9ce5-b1c5b623d996 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/os-volume_attachments/e0bae53e-94db-4bf4-95ca-d454caeae752" status: 202 len: 0 microversion: 2.1 time: 0.372890 Oct 28 08:45:54.934954 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 460/861] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:45:54 2021] DELETE /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/os-volume_attachments/e0bae53e-94db-4bf4-95ca-d454caeae752 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:45:55.174492 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1187a328-ad7c-4841-8290-746e5e8f59c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:55.175111 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1187a328-ad7c-4841-8290-746e5e8f59c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:55.181658 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1187a328-ad7c-4841-8290-746e5e8f59c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:55.182714 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1187a328-ad7c-4841-8290-746e5e8f59c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:55.183485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1187a328-ad7c-4841-8290-746e5e8f59c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:55.183915 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1187a328-ad7c-4841-8290-746e5e8f59c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:55.326140 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1187a328-ad7c-4841-8290-746e5e8f59c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:55.334376 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1187a328-ad7c-4841-8290-746e5e8f59c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:55.335876 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1187a328-ad7c-4841-8290-746e5e8f59c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:55.337165 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1187a328-ad7c-4841-8290-746e5e8f59c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.166326 Oct 28 08:45:55.337718 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 402/862] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:55 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:56.359629 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c3de15d6-b601-4cd5-b4f8-5e17443e4e9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:56.361621 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c3de15d6-b601-4cd5-b4f8-5e17443e4e9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:56.369264 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c3de15d6-b601-4cd5-b4f8-5e17443e4e9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:56.369811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c3de15d6-b601-4cd5-b4f8-5e17443e4e9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:56.370670 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c3de15d6-b601-4cd5-b4f8-5e17443e4e9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:56.372016 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c3de15d6-b601-4cd5-b4f8-5e17443e4e9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:56.526665 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c3de15d6-b601-4cd5-b4f8-5e17443e4e9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:56.536255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c3de15d6-b601-4cd5-b4f8-5e17443e4e9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:56.537763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c3de15d6-b601-4cd5-b4f8-5e17443e4e9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:56.538994 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c3de15d6-b601-4cd5-b4f8-5e17443e4e9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.186425 Oct 28 08:45:56.540134 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 461/863] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:56 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:57.558051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b5ca1d3a-7f88-4fa9-aa76-e308788ed456 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:57.558946 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b5ca1d3a-7f88-4fa9-aa76-e308788ed456 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:57.574051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5ca1d3a-7f88-4fa9-aa76-e308788ed456 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:57.574630 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5ca1d3a-7f88-4fa9-aa76-e308788ed456 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:57.577452 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5ca1d3a-7f88-4fa9-aa76-e308788ed456 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:57.577992 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5ca1d3a-7f88-4fa9-aa76-e308788ed456 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:57.713398 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b5ca1d3a-7f88-4fa9-aa76-e308788ed456 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:57.724452 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b5ca1d3a-7f88-4fa9-aa76-e308788ed456 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:57.725983 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b5ca1d3a-7f88-4fa9-aa76-e308788ed456 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:57.727162 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b5ca1d3a-7f88-4fa9-aa76-e308788ed456 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.172827 Oct 28 08:45:57.727726 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 403/864] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:57 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:58.746470 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f7354dac-3f36-4568-9609-1052295083be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:58.747172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f7354dac-3f36-4568-9609-1052295083be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:58.753707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7354dac-3f36-4568-9609-1052295083be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:58.754179 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7354dac-3f36-4568-9609-1052295083be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:58.754960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7354dac-3f36-4568-9609-1052295083be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:58.755392 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7354dac-3f36-4568-9609-1052295083be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:58.888061 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f7354dac-3f36-4568-9609-1052295083be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:58.897191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f7354dac-3f36-4568-9609-1052295083be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:58.898872 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f7354dac-3f36-4568-9609-1052295083be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:58.900084 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f7354dac-3f36-4568-9609-1052295083be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.158095 Oct 28 08:45:58.900926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 462/865] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:58 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:59.918942 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9a40a63c-b927-49d4-9133-4254a1d50cca tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:59.919912 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9a40a63c-b927-49d4-9133-4254a1d50cca tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:59.926752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a40a63c-b927-49d4-9133-4254a1d50cca tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:59.927191 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a40a63c-b927-49d4-9133-4254a1d50cca tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:59.927954 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a40a63c-b927-49d4-9133-4254a1d50cca tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:59.928378 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a40a63c-b927-49d4-9133-4254a1d50cca tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:00.056700 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9a40a63c-b927-49d4-9133-4254a1d50cca tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:00.066311 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9a40a63c-b927-49d4-9133-4254a1d50cca tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:00.068323 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9a40a63c-b927-49d4-9133-4254a1d50cca tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:00.070026 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9a40a63c-b927-49d4-9133-4254a1d50cca tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.154819 Oct 28 08:46:00.071364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 404/866] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:59 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:01.089637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-112d637c-05b8-4852-9b9c-7098d3531508 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:01.090377 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-112d637c-05b8-4852-9b9c-7098d3531508 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:01.097990 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-112d637c-05b8-4852-9b9c-7098d3531508 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:01.098593 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-112d637c-05b8-4852-9b9c-7098d3531508 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:01.099381 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-112d637c-05b8-4852-9b9c-7098d3531508 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:01.100098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-112d637c-05b8-4852-9b9c-7098d3531508 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:01.239581 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-112d637c-05b8-4852-9b9c-7098d3531508 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:01.249680 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-112d637c-05b8-4852-9b9c-7098d3531508 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:01.251242 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-112d637c-05b8-4852-9b9c-7098d3531508 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:01.252436 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-112d637c-05b8-4852-9b9c-7098d3531508 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.166741 Oct 28 08:46:01.253006 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 463/867] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:01 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:02.270575 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-523bdfca-8a49-4cfe-8684-f92861160a0d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:02.271163 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-523bdfca-8a49-4cfe-8684-f92861160a0d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:02.277225 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-523bdfca-8a49-4cfe-8684-f92861160a0d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:02.277668 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-523bdfca-8a49-4cfe-8684-f92861160a0d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:02.278471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-523bdfca-8a49-4cfe-8684-f92861160a0d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:02.279336 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-523bdfca-8a49-4cfe-8684-f92861160a0d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:02.414449 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-523bdfca-8a49-4cfe-8684-f92861160a0d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:02.423550 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-523bdfca-8a49-4cfe-8684-f92861160a0d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:02.425031 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-523bdfca-8a49-4cfe-8684-f92861160a0d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:02.426204 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-523bdfca-8a49-4cfe-8684-f92861160a0d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.159440 Oct 28 08:46:02.426760 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 405/868] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:02 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:03.444877 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c69dc30c-29a2-4a19-85d7-f2a0b31b382d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:03.445490 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c69dc30c-29a2-4a19-85d7-f2a0b31b382d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:03.452822 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c69dc30c-29a2-4a19-85d7-f2a0b31b382d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:03.453258 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c69dc30c-29a2-4a19-85d7-f2a0b31b382d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:03.454063 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c69dc30c-29a2-4a19-85d7-f2a0b31b382d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:03.454493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c69dc30c-29a2-4a19-85d7-f2a0b31b382d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:03.594674 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c69dc30c-29a2-4a19-85d7-f2a0b31b382d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:03.603307 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c69dc30c-29a2-4a19-85d7-f2a0b31b382d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:03.604781 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c69dc30c-29a2-4a19-85d7-f2a0b31b382d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:03.605966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c69dc30c-29a2-4a19-85d7-f2a0b31b382d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.165332 Oct 28 08:46:03.606504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 464/869] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:03 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:04.624500 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-aa6c9329-5729-4a18-a1f4-cb155a223ec0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:04.625137 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-aa6c9329-5729-4a18-a1f4-cb155a223ec0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:04.631334 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aa6c9329-5729-4a18-a1f4-cb155a223ec0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:04.631777 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aa6c9329-5729-4a18-a1f4-cb155a223ec0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:04.632560 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aa6c9329-5729-4a18-a1f4-cb155a223ec0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:04.632995 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aa6c9329-5729-4a18-a1f4-cb155a223ec0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:04.762324 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aa6c9329-5729-4a18-a1f4-cb155a223ec0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:04.771083 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aa6c9329-5729-4a18-a1f4-cb155a223ec0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:04.772551 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aa6c9329-5729-4a18-a1f4-cb155a223ec0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:04.773697 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-aa6c9329-5729-4a18-a1f4-cb155a223ec0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.153178 Oct 28 08:46:04.774279 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 406/870] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:04 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:05.792546 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c2168ed2-61bb-49dc-a75d-efe687358e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:05.793144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c2168ed2-61bb-49dc-a75d-efe687358e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:05.800193 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c2168ed2-61bb-49dc-a75d-efe687358e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:05.800636 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c2168ed2-61bb-49dc-a75d-efe687358e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:05.801399 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c2168ed2-61bb-49dc-a75d-efe687358e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:05.801855 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c2168ed2-61bb-49dc-a75d-efe687358e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:05.928740 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c2168ed2-61bb-49dc-a75d-efe687358e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:05.937677 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c2168ed2-61bb-49dc-a75d-efe687358e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:05.939290 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c2168ed2-61bb-49dc-a75d-efe687358e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:05.940541 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c2168ed2-61bb-49dc-a75d-efe687358e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.151852 Oct 28 08:46:05.941111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 465/871] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:05 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:06.959512 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5714ac4b-91d3-4276-97a9-f0113fa89f6c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:06.960063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5714ac4b-91d3-4276-97a9-f0113fa89f6c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:06.967029 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5714ac4b-91d3-4276-97a9-f0113fa89f6c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:06.968209 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5714ac4b-91d3-4276-97a9-f0113fa89f6c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:06.968995 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5714ac4b-91d3-4276-97a9-f0113fa89f6c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:06.969427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5714ac4b-91d3-4276-97a9-f0113fa89f6c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:07.105675 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5714ac4b-91d3-4276-97a9-f0113fa89f6c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:07.114955 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5714ac4b-91d3-4276-97a9-f0113fa89f6c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:07.116441 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5714ac4b-91d3-4276-97a9-f0113fa89f6c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:07.117588 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5714ac4b-91d3-4276-97a9-f0113fa89f6c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.161917 Oct 28 08:46:07.118187 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 407/872] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:06 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:08.136133 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-258d355c-9bbe-4a0e-b9bc-8448b890172a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:08.136764 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-258d355c-9bbe-4a0e-b9bc-8448b890172a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:08.143939 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-258d355c-9bbe-4a0e-b9bc-8448b890172a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:08.144468 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-258d355c-9bbe-4a0e-b9bc-8448b890172a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:08.145316 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-258d355c-9bbe-4a0e-b9bc-8448b890172a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:08.145844 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-258d355c-9bbe-4a0e-b9bc-8448b890172a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:08.349984 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-258d355c-9bbe-4a0e-b9bc-8448b890172a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:08.359492 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-258d355c-9bbe-4a0e-b9bc-8448b890172a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:08.360968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-258d355c-9bbe-4a0e-b9bc-8448b890172a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:08.362159 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-258d355c-9bbe-4a0e-b9bc-8448b890172a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.229874 Oct 28 08:46:08.362727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 466/873] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:08 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:09.380262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-034a1531-7466-4102-b529-f7cfa6ddc99c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:09.380859 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-034a1531-7466-4102-b529-f7cfa6ddc99c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:09.388552 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-034a1531-7466-4102-b529-f7cfa6ddc99c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:09.389006 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-034a1531-7466-4102-b529-f7cfa6ddc99c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:09.390070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-034a1531-7466-4102-b529-f7cfa6ddc99c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:09.390552 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-034a1531-7466-4102-b529-f7cfa6ddc99c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:09.523007 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-034a1531-7466-4102-b529-f7cfa6ddc99c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:09.532022 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-034a1531-7466-4102-b529-f7cfa6ddc99c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:09.533503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-034a1531-7466-4102-b529-f7cfa6ddc99c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:09.534685 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-034a1531-7466-4102-b529-f7cfa6ddc99c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.158151 Oct 28 08:46:09.535243 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 408/874] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:09 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:09.762372 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-37a06838-9143-4b88-9af8-8da77aad9e0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:46:09.768960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-37a06838-9143-4b88-9af8-8da77aad9e0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:09.769408 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-37a06838-9143-4b88-9af8-8da77aad9e0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:09.791740 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-37a06838-9143-4b88-9af8-8da77aad9e0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Going to try to stop instance {{(pid=132797) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 08:46:09.837426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-37a06838-9143-4b88-9af8-8da77aad9e0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 202 len: 0 microversion: 2.1 time: 0.078788 Oct 28 08:46:09.838065 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 467/875] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:46:09 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:46:09.847350 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f77ae452-6d57-40fe-91f7-2d09eefaffdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:09.847979 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f77ae452-6d57-40fe-91f7-2d09eefaffdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:09.853754 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f77ae452-6d57-40fe-91f7-2d09eefaffdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:09.854224 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f77ae452-6d57-40fe-91f7-2d09eefaffdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:09.855080 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f77ae452-6d57-40fe-91f7-2d09eefaffdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:09.855514 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f77ae452-6d57-40fe-91f7-2d09eefaffdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:09.980047 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f77ae452-6d57-40fe-91f7-2d09eefaffdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:09.988330 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f77ae452-6d57-40fe-91f7-2d09eefaffdb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.144545 Oct 28 08:46:09.988896 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 409/876] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:09 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:10.562293 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-666380fd-7d66-4fa4-ad93-ec9e94b0c43b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:10.563183 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-666380fd-7d66-4fa4-ad93-ec9e94b0c43b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:10.569086 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-666380fd-7d66-4fa4-ad93-ec9e94b0c43b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:10.569531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-666380fd-7d66-4fa4-ad93-ec9e94b0c43b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:10.570492 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-666380fd-7d66-4fa4-ad93-ec9e94b0c43b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:10.570926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-666380fd-7d66-4fa4-ad93-ec9e94b0c43b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:10.702191 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-666380fd-7d66-4fa4-ad93-ec9e94b0c43b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:10.710743 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-666380fd-7d66-4fa4-ad93-ec9e94b0c43b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:10.712235 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-666380fd-7d66-4fa4-ad93-ec9e94b0c43b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:10.713413 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-666380fd-7d66-4fa4-ad93-ec9e94b0c43b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.155662 Oct 28 08:46:10.714001 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 468/877] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:10 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:11.006189 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-dee60969-2882-47d6-86d4-99ee8647b302 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:11.006757 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-dee60969-2882-47d6-86d4-99ee8647b302 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:11.013916 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dee60969-2882-47d6-86d4-99ee8647b302 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:11.014370 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dee60969-2882-47d6-86d4-99ee8647b302 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:11.015164 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dee60969-2882-47d6-86d4-99ee8647b302 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:11.015598 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dee60969-2882-47d6-86d4-99ee8647b302 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:11.147124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-dee60969-2882-47d6-86d4-99ee8647b302 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:11.155174 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-dee60969-2882-47d6-86d4-99ee8647b302 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.152898 Oct 28 08:46:11.155735 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 410/878] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:11 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:11.734222 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3fa2c684-0040-4477-bca9-386c4d64bec4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:11.734882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3fa2c684-0040-4477-bca9-386c4d64bec4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:11.741617 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3fa2c684-0040-4477-bca9-386c4d64bec4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:11.742099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3fa2c684-0040-4477-bca9-386c4d64bec4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:11.742999 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3fa2c684-0040-4477-bca9-386c4d64bec4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:11.743316 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3fa2c684-0040-4477-bca9-386c4d64bec4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:11.876298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3fa2c684-0040-4477-bca9-386c4d64bec4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:11.885298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3fa2c684-0040-4477-bca9-386c4d64bec4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:11.887034 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3fa2c684-0040-4477-bca9-386c4d64bec4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:11.888805 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3fa2c684-0040-4477-bca9-386c4d64bec4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.158880 Oct 28 08:46:11.889370 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 469/879] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:11 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:12.172987 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5faec5a0-aa45-485b-831a-5f660fd8c05d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:12.173629 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5faec5a0-aa45-485b-831a-5f660fd8c05d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:12.179922 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5faec5a0-aa45-485b-831a-5f660fd8c05d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:12.180370 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5faec5a0-aa45-485b-831a-5f660fd8c05d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:12.181141 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5faec5a0-aa45-485b-831a-5f660fd8c05d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:12.181574 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5faec5a0-aa45-485b-831a-5f660fd8c05d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:12.309009 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5faec5a0-aa45-485b-831a-5f660fd8c05d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:12.315715 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5faec5a0-aa45-485b-831a-5f660fd8c05d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.146536 Oct 28 08:46:12.316409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 411/880] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:12 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:12.908279 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0606a237-f303-4079-a077-6f9bec78c7b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:12.908887 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0606a237-f303-4079-a077-6f9bec78c7b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:12.915386 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0606a237-f303-4079-a077-6f9bec78c7b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:12.915847 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0606a237-f303-4079-a077-6f9bec78c7b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:12.916644 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0606a237-f303-4079-a077-6f9bec78c7b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:12.917037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0606a237-f303-4079-a077-6f9bec78c7b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:13.060446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0606a237-f303-4079-a077-6f9bec78c7b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:13.069753 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0606a237-f303-4079-a077-6f9bec78c7b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:13.071546 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0606a237-f303-4079-a077-6f9bec78c7b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:13.072712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0606a237-f303-4079-a077-6f9bec78c7b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.168544 Oct 28 08:46:13.073613 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 470/881] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:12 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:13.333122 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-dac10997-c558-497c-aa6e-1fae850554da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:13.333727 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-dac10997-c558-497c-aa6e-1fae850554da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:13.340203 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dac10997-c558-497c-aa6e-1fae850554da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:13.340656 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dac10997-c558-497c-aa6e-1fae850554da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:13.341942 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dac10997-c558-497c-aa6e-1fae850554da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:13.342853 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dac10997-c558-497c-aa6e-1fae850554da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:13.480155 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-dac10997-c558-497c-aa6e-1fae850554da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:13.487626 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-dac10997-c558-497c-aa6e-1fae850554da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.158206 Oct 28 08:46:13.488195 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 412/882] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:13 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:14.093649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-74fdbbd4-24c9-4dd0-87e9-f7956b0c7f41 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:14.094268 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-74fdbbd4-24c9-4dd0-87e9-f7956b0c7f41 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:14.100489 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74fdbbd4-24c9-4dd0-87e9-f7956b0c7f41 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:14.100941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74fdbbd4-24c9-4dd0-87e9-f7956b0c7f41 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:14.101711 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74fdbbd4-24c9-4dd0-87e9-f7956b0c7f41 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:14.102176 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74fdbbd4-24c9-4dd0-87e9-f7956b0c7f41 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:14.235361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-74fdbbd4-24c9-4dd0-87e9-f7956b0c7f41 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:14.244519 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-74fdbbd4-24c9-4dd0-87e9-f7956b0c7f41 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:14.246033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-74fdbbd4-24c9-4dd0-87e9-f7956b0c7f41 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:14.247268 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-74fdbbd4-24c9-4dd0-87e9-f7956b0c7f41 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.157954 Oct 28 08:46:14.248980 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 471/883] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:14 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:14.504893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e47905f4-3f93-4f5f-aba5-d83a63f5408f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:14.505436 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e47905f4-3f93-4f5f-aba5-d83a63f5408f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:14.512018 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e47905f4-3f93-4f5f-aba5-d83a63f5408f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:14.512467 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e47905f4-3f93-4f5f-aba5-d83a63f5408f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:14.513344 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e47905f4-3f93-4f5f-aba5-d83a63f5408f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:14.513950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e47905f4-3f93-4f5f-aba5-d83a63f5408f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:14.641007 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e47905f4-3f93-4f5f-aba5-d83a63f5408f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:14.649676 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e47905f4-3f93-4f5f-aba5-d83a63f5408f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.148633 Oct 28 08:46:14.650290 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 413/884] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:14 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:15.268089 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-78b0fe7b-3624-4b45-8251-167b446e1308 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:15.268622 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-78b0fe7b-3624-4b45-8251-167b446e1308 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:15.275153 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-78b0fe7b-3624-4b45-8251-167b446e1308 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:15.275599 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-78b0fe7b-3624-4b45-8251-167b446e1308 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:15.276385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-78b0fe7b-3624-4b45-8251-167b446e1308 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:15.276816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-78b0fe7b-3624-4b45-8251-167b446e1308 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:15.402399 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-78b0fe7b-3624-4b45-8251-167b446e1308 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:15.411258 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-78b0fe7b-3624-4b45-8251-167b446e1308 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:15.412751 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-78b0fe7b-3624-4b45-8251-167b446e1308 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:15.413952 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-78b0fe7b-3624-4b45-8251-167b446e1308 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.150347 Oct 28 08:46:15.414518 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 472/885] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:15 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:15.670791 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-047abc97-1586-4e05-94b1-b2e5d370050d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:15.671848 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-047abc97-1586-4e05-94b1-b2e5d370050d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:15.679492 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-047abc97-1586-4e05-94b1-b2e5d370050d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:15.679969 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-047abc97-1586-4e05-94b1-b2e5d370050d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:15.680762 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-047abc97-1586-4e05-94b1-b2e5d370050d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:15.681197 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-047abc97-1586-4e05-94b1-b2e5d370050d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:15.808616 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-047abc97-1586-4e05-94b1-b2e5d370050d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:15.819187 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-047abc97-1586-4e05-94b1-b2e5d370050d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.154723 Oct 28 08:46:15.819790 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 414/886] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:15 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:16.432317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-773ab422-7865-4f05-96cd-afc025dc7e22 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:16.432946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-773ab422-7865-4f05-96cd-afc025dc7e22 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:16.440289 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-773ab422-7865-4f05-96cd-afc025dc7e22 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:16.440728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-773ab422-7865-4f05-96cd-afc025dc7e22 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:16.441501 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-773ab422-7865-4f05-96cd-afc025dc7e22 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:16.441995 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-773ab422-7865-4f05-96cd-afc025dc7e22 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:16.581772 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-773ab422-7865-4f05-96cd-afc025dc7e22 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:16.590683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-773ab422-7865-4f05-96cd-afc025dc7e22 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:16.593527 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-773ab422-7865-4f05-96cd-afc025dc7e22 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:16.595022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-773ab422-7865-4f05-96cd-afc025dc7e22 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.166507 Oct 28 08:46:16.595591 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 473/887] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:16 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:16.837331 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f5f33c26-32c2-43c1-a7f4-9eeb8ee1ccfa tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:16.837958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f5f33c26-32c2-43c1-a7f4-9eeb8ee1ccfa tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:16.845067 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5f33c26-32c2-43c1-a7f4-9eeb8ee1ccfa tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:16.845507 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5f33c26-32c2-43c1-a7f4-9eeb8ee1ccfa tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:16.846308 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5f33c26-32c2-43c1-a7f4-9eeb8ee1ccfa tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:16.846744 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5f33c26-32c2-43c1-a7f4-9eeb8ee1ccfa tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:17.209820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f5f33c26-32c2-43c1-a7f4-9eeb8ee1ccfa tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:17.217669 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f5f33c26-32c2-43c1-a7f4-9eeb8ee1ccfa tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.383952 Oct 28 08:46:17.218267 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 415/888] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:16 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:17.613931 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-278914a5-cd37-4a8b-ab62-587f8b8f8523 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:17.614479 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-278914a5-cd37-4a8b-ab62-587f8b8f8523 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:17.621198 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-278914a5-cd37-4a8b-ab62-587f8b8f8523 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:17.621647 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-278914a5-cd37-4a8b-ab62-587f8b8f8523 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:17.622548 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-278914a5-cd37-4a8b-ab62-587f8b8f8523 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:17.623981 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-278914a5-cd37-4a8b-ab62-587f8b8f8523 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:17.754705 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-278914a5-cd37-4a8b-ab62-587f8b8f8523 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:17.764664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-278914a5-cd37-4a8b-ab62-587f8b8f8523 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:17.766188 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-278914a5-cd37-4a8b-ab62-587f8b8f8523 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:17.767342 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-278914a5-cd37-4a8b-ab62-587f8b8f8523 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.157722 Oct 28 08:46:17.767908 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 474/889] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:17 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:18.235094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3f2c645d-debe-4368-a09e-d82635cac164 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:18.235748 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3f2c645d-debe-4368-a09e-d82635cac164 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:18.241899 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f2c645d-debe-4368-a09e-d82635cac164 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:18.242341 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f2c645d-debe-4368-a09e-d82635cac164 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:18.243097 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f2c645d-debe-4368-a09e-d82635cac164 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:18.243525 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f2c645d-debe-4368-a09e-d82635cac164 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:18.371837 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3f2c645d-debe-4368-a09e-d82635cac164 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:18.380132 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3f2c645d-debe-4368-a09e-d82635cac164 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.149137 Oct 28 08:46:18.380750 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 416/890] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:18 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:18.786261 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fefed1c9-ae43-446e-9f68-da4bff55fe93 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:18.786884 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fefed1c9-ae43-446e-9f68-da4bff55fe93 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:18.793394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fefed1c9-ae43-446e-9f68-da4bff55fe93 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:18.793988 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fefed1c9-ae43-446e-9f68-da4bff55fe93 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:18.794744 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fefed1c9-ae43-446e-9f68-da4bff55fe93 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:18.795301 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fefed1c9-ae43-446e-9f68-da4bff55fe93 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:18.918913 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fefed1c9-ae43-446e-9f68-da4bff55fe93 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:18.927132 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fefed1c9-ae43-446e-9f68-da4bff55fe93 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:18.928613 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fefed1c9-ae43-446e-9f68-da4bff55fe93 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:18.929757 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fefed1c9-ae43-446e-9f68-da4bff55fe93 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.147196 Oct 28 08:46:18.930345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 475/891] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:18 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:19.396946 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1cd1bc41-9c90-47b9-a15b-719657fb2bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:19.397584 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1cd1bc41-9c90-47b9-a15b-719657fb2bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:19.403896 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1cd1bc41-9c90-47b9-a15b-719657fb2bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:19.404984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1cd1bc41-9c90-47b9-a15b-719657fb2bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:19.405751 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1cd1bc41-9c90-47b9-a15b-719657fb2bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:19.406210 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1cd1bc41-9c90-47b9-a15b-719657fb2bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:19.526437 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1cd1bc41-9c90-47b9-a15b-719657fb2bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:19.535561 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1cd1bc41-9c90-47b9-a15b-719657fb2bbd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.142190 Oct 28 08:46:19.536137 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 417/892] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:19 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:46:19.948177 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-cc67c060-3dd4-497d-bd8e-221b370914ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:19.948772 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-cc67c060-3dd4-497d-bd8e-221b370914ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:19.956102 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cc67c060-3dd4-497d-bd8e-221b370914ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:19.956547 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cc67c060-3dd4-497d-bd8e-221b370914ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:19.957318 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cc67c060-3dd4-497d-bd8e-221b370914ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:19.957751 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cc67c060-3dd4-497d-bd8e-221b370914ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:20.083478 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-cc67c060-3dd4-497d-bd8e-221b370914ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:20.092475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-cc67c060-3dd4-497d-bd8e-221b370914ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:20.094040 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-cc67c060-3dd4-497d-bd8e-221b370914ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:20.095305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-cc67c060-3dd4-497d-bd8e-221b370914ad tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.150892 Oct 28 08:46:20.095881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 476/893] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:19 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:20.552487 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8c8d1a57-9519-49c9-b01b-73c8410209ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:20.553083 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8c8d1a57-9519-49c9-b01b-73c8410209ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:20.559233 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8c8d1a57-9519-49c9-b01b-73c8410209ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:20.559669 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8c8d1a57-9519-49c9-b01b-73c8410209ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:20.560417 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8c8d1a57-9519-49c9-b01b-73c8410209ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:20.561303 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8c8d1a57-9519-49c9-b01b-73c8410209ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:20.688812 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8c8d1a57-9519-49c9-b01b-73c8410209ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:20.696250 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8c8d1a57-9519-49c9-b01b-73c8410209ab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.147424 Oct 28 08:46:20.696808 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 418/894] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:20 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:46:21.113557 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-46dc3e29-c545-45ff-88d1-e22cfba7097c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:21.114193 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-46dc3e29-c545-45ff-88d1-e22cfba7097c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:21.120439 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-46dc3e29-c545-45ff-88d1-e22cfba7097c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:21.120892 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-46dc3e29-c545-45ff-88d1-e22cfba7097c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:21.121657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-46dc3e29-c545-45ff-88d1-e22cfba7097c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:21.122122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-46dc3e29-c545-45ff-88d1-e22cfba7097c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:21.243629 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-46dc3e29-c545-45ff-88d1-e22cfba7097c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:21.253740 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-46dc3e29-c545-45ff-88d1-e22cfba7097c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:21.255230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-46dc3e29-c545-45ff-88d1-e22cfba7097c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:21.256385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-46dc3e29-c545-45ff-88d1-e22cfba7097c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.147062 Oct 28 08:46:21.256946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 477/895] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:21 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:21.715749 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-12b93ac9-9e03-4d10-b11e-308fbc865994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:21.716305 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-12b93ac9-9e03-4d10-b11e-308fbc865994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:21.723534 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12b93ac9-9e03-4d10-b11e-308fbc865994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:21.723977 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12b93ac9-9e03-4d10-b11e-308fbc865994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:21.724775 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12b93ac9-9e03-4d10-b11e-308fbc865994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:21.725204 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12b93ac9-9e03-4d10-b11e-308fbc865994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:21.856642 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-12b93ac9-9e03-4d10-b11e-308fbc865994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:21.863948 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-12b93ac9-9e03-4d10-b11e-308fbc865994 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.152146 Oct 28 08:46:21.864524 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 419/896] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:21 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:46:22.274572 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9e6c46fc-6d34-409e-b78f-19d3e23ca4e0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:22.275215 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9e6c46fc-6d34-409e-b78f-19d3e23ca4e0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:22.289031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9e6c46fc-6d34-409e-b78f-19d3e23ca4e0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:22.289031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9e6c46fc-6d34-409e-b78f-19d3e23ca4e0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:22.289031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9e6c46fc-6d34-409e-b78f-19d3e23ca4e0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:22.289031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9e6c46fc-6d34-409e-b78f-19d3e23ca4e0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:22.409101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9e6c46fc-6d34-409e-b78f-19d3e23ca4e0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:22.417322 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9e6c46fc-6d34-409e-b78f-19d3e23ca4e0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:22.418840 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9e6c46fc-6d34-409e-b78f-19d3e23ca4e0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:22.420015 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9e6c46fc-6d34-409e-b78f-19d3e23ca4e0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.149096 Oct 28 08:46:22.420614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 478/897] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:22 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:22.888320 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bee0eb2d-246a-48a5-b485-f1ec513ccf0b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:22.889201 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bee0eb2d-246a-48a5-b485-f1ec513ccf0b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:22.895604 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bee0eb2d-246a-48a5-b485-f1ec513ccf0b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:22.896051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bee0eb2d-246a-48a5-b485-f1ec513ccf0b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:22.896848 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bee0eb2d-246a-48a5-b485-f1ec513ccf0b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:22.897282 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bee0eb2d-246a-48a5-b485-f1ec513ccf0b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:23.021752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-bee0eb2d-246a-48a5-b485-f1ec513ccf0b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:23.029152 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bee0eb2d-246a-48a5-b485-f1ec513ccf0b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.144525 Oct 28 08:46:23.030007 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 420/898] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:22 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:23.546834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6e410363-094c-4f63-b788-e87bf39ff0e8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:23.547448 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6e410363-094c-4f63-b788-e87bf39ff0e8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:23.553254 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6e410363-094c-4f63-b788-e87bf39ff0e8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:23.553637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6e410363-094c-4f63-b788-e87bf39ff0e8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:23.554437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6e410363-094c-4f63-b788-e87bf39ff0e8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:23.554865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6e410363-094c-4f63-b788-e87bf39ff0e8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:23.684612 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6e410363-094c-4f63-b788-e87bf39ff0e8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:23.700109 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6e410363-094c-4f63-b788-e87bf39ff0e8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:23.702183 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6e410363-094c-4f63-b788-e87bf39ff0e8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:23.703368 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6e410363-094c-4f63-b788-e87bf39ff0e8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.268743 Oct 28 08:46:23.703924 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 479/899] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:23 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:46:24.047221 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e39a0772-3a35-443e-ad5f-bec3f7d7e7b3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:24.047828 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e39a0772-3a35-443e-ad5f-bec3f7d7e7b3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:24.054063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e39a0772-3a35-443e-ad5f-bec3f7d7e7b3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:24.054535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e39a0772-3a35-443e-ad5f-bec3f7d7e7b3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:24.055358 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e39a0772-3a35-443e-ad5f-bec3f7d7e7b3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:24.055790 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e39a0772-3a35-443e-ad5f-bec3f7d7e7b3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:24.183979 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e39a0772-3a35-443e-ad5f-bec3f7d7e7b3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:24.192371 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e39a0772-3a35-443e-ad5f-bec3f7d7e7b3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.149398 Oct 28 08:46:24.192941 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 421/900] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:24 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:24.722174 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5efe3521-3f1e-4968-9c68-1d21a9598192 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:24.722812 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5efe3521-3f1e-4968-9c68-1d21a9598192 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:24.729159 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5efe3521-3f1e-4968-9c68-1d21a9598192 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:24.729605 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5efe3521-3f1e-4968-9c68-1d21a9598192 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:24.736848 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5efe3521-3f1e-4968-9c68-1d21a9598192 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:24.736848 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5efe3521-3f1e-4968-9c68-1d21a9598192 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:24.862342 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5efe3521-3f1e-4968-9c68-1d21a9598192 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:24.870551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5efe3521-3f1e-4968-9c68-1d21a9598192 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:24.872503 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5efe3521-3f1e-4968-9c68-1d21a9598192 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:24.875052 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5efe3521-3f1e-4968-9c68-1d21a9598192 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.156778 Oct 28 08:46:24.875611 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 480/901] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:24 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:25.209409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d9507454-df72-4a9e-8810-b68311ff68e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:25.210065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d9507454-df72-4a9e-8810-b68311ff68e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:25.216267 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9507454-df72-4a9e-8810-b68311ff68e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:25.216713 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9507454-df72-4a9e-8810-b68311ff68e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:25.218039 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9507454-df72-4a9e-8810-b68311ff68e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:25.218472 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9507454-df72-4a9e-8810-b68311ff68e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:25.344520 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d9507454-df72-4a9e-8810-b68311ff68e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:25.352058 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d9507454-df72-4a9e-8810-b68311ff68e7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.146362 Oct 28 08:46:25.353072 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 422/902] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:25 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:25.893777 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-96676e56-bd3a-4580-a20d-333f8c6d6a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:25.894487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-96676e56-bd3a-4580-a20d-333f8c6d6a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:25.900792 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-96676e56-bd3a-4580-a20d-333f8c6d6a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:25.901276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-96676e56-bd3a-4580-a20d-333f8c6d6a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:25.902080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-96676e56-bd3a-4580-a20d-333f8c6d6a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:25.902512 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-96676e56-bd3a-4580-a20d-333f8c6d6a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:26.027022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-96676e56-bd3a-4580-a20d-333f8c6d6a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:26.037160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-96676e56-bd3a-4580-a20d-333f8c6d6a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:26.038784 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-96676e56-bd3a-4580-a20d-333f8c6d6a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:26.039971 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-96676e56-bd3a-4580-a20d-333f8c6d6a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.150629 Oct 28 08:46:26.040576 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 481/903] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:25 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:26.370036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6805b34d-af18-4f0c-b36d-0ae0a14d7415 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:26.370626 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6805b34d-af18-4f0c-b36d-0ae0a14d7415 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:26.377521 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6805b34d-af18-4f0c-b36d-0ae0a14d7415 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:26.378066 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6805b34d-af18-4f0c-b36d-0ae0a14d7415 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:26.378889 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6805b34d-af18-4f0c-b36d-0ae0a14d7415 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:26.379235 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6805b34d-af18-4f0c-b36d-0ae0a14d7415 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:26.502551 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6805b34d-af18-4f0c-b36d-0ae0a14d7415 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:26.511053 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6805b34d-af18-4f0c-b36d-0ae0a14d7415 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.144574 Oct 28 08:46:26.511631 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 423/904] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:26 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:27.058882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ed0ffd20-b5a5-4a1d-aadf-9dfee59d2262 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:27.059524 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ed0ffd20-b5a5-4a1d-aadf-9dfee59d2262 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:27.066560 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed0ffd20-b5a5-4a1d-aadf-9dfee59d2262 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:27.067002 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed0ffd20-b5a5-4a1d-aadf-9dfee59d2262 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:27.067770 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed0ffd20-b5a5-4a1d-aadf-9dfee59d2262 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:27.068204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ed0ffd20-b5a5-4a1d-aadf-9dfee59d2262 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:27.205016 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ed0ffd20-b5a5-4a1d-aadf-9dfee59d2262 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:27.213147 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ed0ffd20-b5a5-4a1d-aadf-9dfee59d2262 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:27.214663 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ed0ffd20-b5a5-4a1d-aadf-9dfee59d2262 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:27.215809 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ed0ffd20-b5a5-4a1d-aadf-9dfee59d2262 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.160646 Oct 28 08:46:27.216364 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 482/905] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:27 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:27.528641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b3914904-5df3-4683-9e7a-9c000e0f1d65 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:27.529268 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b3914904-5df3-4683-9e7a-9c000e0f1d65 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:27.536323 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3914904-5df3-4683-9e7a-9c000e0f1d65 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:27.536760 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3914904-5df3-4683-9e7a-9c000e0f1d65 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:27.537515 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3914904-5df3-4683-9e7a-9c000e0f1d65 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:27.538038 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b3914904-5df3-4683-9e7a-9c000e0f1d65 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:27.678404 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b3914904-5df3-4683-9e7a-9c000e0f1d65 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:27.685930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b3914904-5df3-4683-9e7a-9c000e0f1d65 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.160885 Oct 28 08:46:27.686564 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 424/906] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:27 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:28.234940 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3b38e51c-2eb3-402d-bb0f-946e672cbfc3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:28.235597 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3b38e51c-2eb3-402d-bb0f-946e672cbfc3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:28.241794 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3b38e51c-2eb3-402d-bb0f-946e672cbfc3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:28.242257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3b38e51c-2eb3-402d-bb0f-946e672cbfc3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:28.243012 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3b38e51c-2eb3-402d-bb0f-946e672cbfc3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:28.243436 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3b38e51c-2eb3-402d-bb0f-946e672cbfc3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:28.368091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3b38e51c-2eb3-402d-bb0f-946e672cbfc3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:28.377436 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3b38e51c-2eb3-402d-bb0f-946e672cbfc3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:28.379006 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3b38e51c-2eb3-402d-bb0f-946e672cbfc3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:28.380239 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3b38e51c-2eb3-402d-bb0f-946e672cbfc3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.149722 Oct 28 08:46:28.380923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 483/907] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:28 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:28.703909 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3dff1630-3773-4fa3-b0d9-2d1a6adab57a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:28.704711 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3dff1630-3773-4fa3-b0d9-2d1a6adab57a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:28.711035 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3dff1630-3773-4fa3-b0d9-2d1a6adab57a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:28.711433 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3dff1630-3773-4fa3-b0d9-2d1a6adab57a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:28.712211 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3dff1630-3773-4fa3-b0d9-2d1a6adab57a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:28.712651 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3dff1630-3773-4fa3-b0d9-2d1a6adab57a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:28.849116 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3dff1630-3773-4fa3-b0d9-2d1a6adab57a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:28.857016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3dff1630-3773-4fa3-b0d9-2d1a6adab57a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.157319 Oct 28 08:46:28.857611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 425/908] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:28 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:29.398930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-22483560-6550-4fb5-9fcc-35f70bc8e6ac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:29.399519 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-22483560-6550-4fb5-9fcc-35f70bc8e6ac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:29.406237 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-22483560-6550-4fb5-9fcc-35f70bc8e6ac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:29.406685 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-22483560-6550-4fb5-9fcc-35f70bc8e6ac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:29.407479 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-22483560-6550-4fb5-9fcc-35f70bc8e6ac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:29.407912 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-22483560-6550-4fb5-9fcc-35f70bc8e6ac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:29.543530 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-22483560-6550-4fb5-9fcc-35f70bc8e6ac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:29.552587 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-22483560-6550-4fb5-9fcc-35f70bc8e6ac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:29.554088 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-22483560-6550-4fb5-9fcc-35f70bc8e6ac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:29.555241 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-22483560-6550-4fb5-9fcc-35f70bc8e6ac tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.160066 Oct 28 08:46:29.555819 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 484/909] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:29 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:29.871888 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:46:29.872110 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: Thu Oct 28 08:46:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:46:29.874239 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8a8c143e-fc14-4e73-b45b-91dce7a9d733 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:29.875548 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8a8c143e-fc14-4e73-b45b-91dce7a9d733 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:29.883389 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a8c143e-fc14-4e73-b45b-91dce7a9d733 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:29.883869 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a8c143e-fc14-4e73-b45b-91dce7a9d733 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:29.884660 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a8c143e-fc14-4e73-b45b-91dce7a9d733 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:29.885106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a8c143e-fc14-4e73-b45b-91dce7a9d733 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:30.014446 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8a8c143e-fc14-4e73-b45b-91dce7a9d733 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:30.021715 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8a8c143e-fc14-4e73-b45b-91dce7a9d733 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.151133 Oct 28 08:46:30.022320 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 426/910] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:29 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:30.574452 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f30bcd0b-3fd6-4282-8c18-7a0190304f96 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:30.575080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f30bcd0b-3fd6-4282-8c18-7a0190304f96 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:30.582426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f30bcd0b-3fd6-4282-8c18-7a0190304f96 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:30.582890 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f30bcd0b-3fd6-4282-8c18-7a0190304f96 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:30.583627 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f30bcd0b-3fd6-4282-8c18-7a0190304f96 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:30.584056 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f30bcd0b-3fd6-4282-8c18-7a0190304f96 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:30.713412 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f30bcd0b-3fd6-4282-8c18-7a0190304f96 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:30.723258 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f30bcd0b-3fd6-4282-8c18-7a0190304f96 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:30.724904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f30bcd0b-3fd6-4282-8c18-7a0190304f96 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:30.725986 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f30bcd0b-3fd6-4282-8c18-7a0190304f96 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.155288 Oct 28 08:46:30.726851 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 485/911] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:30 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:31.039849 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e86617ec-66e1-4c06-86ad-7d2017d1074d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:31.040455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e86617ec-66e1-4c06-86ad-7d2017d1074d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:31.047562 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e86617ec-66e1-4c06-86ad-7d2017d1074d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:31.048076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e86617ec-66e1-4c06-86ad-7d2017d1074d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:31.048972 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e86617ec-66e1-4c06-86ad-7d2017d1074d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:31.049407 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e86617ec-66e1-4c06-86ad-7d2017d1074d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:31.173567 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e86617ec-66e1-4c06-86ad-7d2017d1074d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:31.180886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e86617ec-66e1-4c06-86ad-7d2017d1074d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.144700 Oct 28 08:46:31.181451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 427/912] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:31 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:31.745518 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-06221486-c872-47d3-86fe-5863ce7c79f9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:31.746200 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-06221486-c872-47d3-86fe-5863ce7c79f9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:31.753194 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-06221486-c872-47d3-86fe-5863ce7c79f9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:31.753641 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-06221486-c872-47d3-86fe-5863ce7c79f9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:31.754463 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-06221486-c872-47d3-86fe-5863ce7c79f9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:31.754895 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-06221486-c872-47d3-86fe-5863ce7c79f9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:31.906582 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-06221486-c872-47d3-86fe-5863ce7c79f9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:31.919252 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-06221486-c872-47d3-86fe-5863ce7c79f9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:31.922047 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-06221486-c872-47d3-86fe-5863ce7c79f9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:31.923491 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-06221486-c872-47d3-86fe-5863ce7c79f9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.181738 Oct 28 08:46:31.924236 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 486/913] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:31 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:32.200375 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6603f9e1-fee0-4309-b0cd-4a9caa4d680c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:32.200959 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6603f9e1-fee0-4309-b0cd-4a9caa4d680c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:32.208159 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6603f9e1-fee0-4309-b0cd-4a9caa4d680c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:32.208604 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6603f9e1-fee0-4309-b0cd-4a9caa4d680c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:32.209379 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6603f9e1-fee0-4309-b0cd-4a9caa4d680c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:32.209827 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6603f9e1-fee0-4309-b0cd-4a9caa4d680c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:32.345032 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6603f9e1-fee0-4309-b0cd-4a9caa4d680c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:32.352531 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6603f9e1-fee0-4309-b0cd-4a9caa4d680c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.156858 Oct 28 08:46:32.353111 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 428/914] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:32 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:32.366494 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-a4181335-e5a8-40a3-a610-d07f2774958e req-a383779e-3a23-475d-a5ba-a6561c27d04b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423157c3-a1e9-43c5-8fda-01d1d93bd484", "name": "network-vif-plugged", "status": "completed", "tag": "2e8c6f82-a258-4342-aacf-0b4e80ccd12e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:46:32.368069 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:46:32.368069 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:46:32.375679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-a4181335-e5a8-40a3-a610-d07f2774958e req-a383779e-3a23-475d-a5ba-a6561c27d04b service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:32.376111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-a4181335-e5a8-40a3-a610-d07f2774958e req-a383779e-3a23-475d-a5ba-a6561c27d04b service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:32.386972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-a4181335-e5a8-40a3-a610-d07f2774958e req-a383779e-3a23-475d-a5ba-a6561c27d04b service nova] Creating event network-vif-plugged:2e8c6f82-a258-4342-aacf-0b4e80ccd12e for instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 on hv-cinder-81566 Oct 28 08:46:32.393739 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-a4181335-e5a8-40a3-a610-d07f2774958e req-a383779e-3a23-475d-a5ba-a6561c27d04b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035686 Oct 28 08:46:32.394404 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 487/915] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:46:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:46:32.945657 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f422c2c2-b9b8-4e93-93de-e022e536c662 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:32.946219 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f422c2c2-b9b8-4e93-93de-e022e536c662 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:32.951953 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f422c2c2-b9b8-4e93-93de-e022e536c662 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:32.952396 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f422c2c2-b9b8-4e93-93de-e022e536c662 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:32.953347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f422c2c2-b9b8-4e93-93de-e022e536c662 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:32.953671 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f422c2c2-b9b8-4e93-93de-e022e536c662 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:33.099596 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f422c2c2-b9b8-4e93-93de-e022e536c662 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:33.106058 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f422c2c2-b9b8-4e93-93de-e022e536c662 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:33.107608 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f422c2c2-b9b8-4e93-93de-e022e536c662 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:33.109317 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f422c2c2-b9b8-4e93-93de-e022e536c662 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.167078 Oct 28 08:46:33.109932 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 429/916] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:32 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:33.371710 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-15a296ba-630d-429b-9473-efe4828f9f1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:33.372414 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-15a296ba-630d-429b-9473-efe4828f9f1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:33.385991 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-15a296ba-630d-429b-9473-efe4828f9f1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:33.386437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-15a296ba-630d-429b-9473-efe4828f9f1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:33.387284 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-15a296ba-630d-429b-9473-efe4828f9f1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:33.387712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-15a296ba-630d-429b-9473-efe4828f9f1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:33.518425 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-15a296ba-630d-429b-9473-efe4828f9f1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:33.525917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-15a296ba-630d-429b-9473-efe4828f9f1f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.158878 Oct 28 08:46:33.526498 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 488/917] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:33 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:34.127839 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ba1cd563-e25c-4524-a2be-2088244cbbfd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:34.128470 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ba1cd563-e25c-4524-a2be-2088244cbbfd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:34.134622 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ba1cd563-e25c-4524-a2be-2088244cbbfd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:34.135067 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ba1cd563-e25c-4524-a2be-2088244cbbfd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:34.135829 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ba1cd563-e25c-4524-a2be-2088244cbbfd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:34.136260 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ba1cd563-e25c-4524-a2be-2088244cbbfd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:34.263536 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ba1cd563-e25c-4524-a2be-2088244cbbfd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:34.277874 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ba1cd563-e25c-4524-a2be-2088244cbbfd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:34.279381 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ba1cd563-e25c-4524-a2be-2088244cbbfd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:34.281376 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ba1cd563-e25c-4524-a2be-2088244cbbfd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.156884 Oct 28 08:46:34.281989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 430/918] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:34 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:34.545886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-cef1d612-9125-481f-af0a-91692422b32c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:34.547787 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-cef1d612-9125-481f-af0a-91692422b32c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:34.556979 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cef1d612-9125-481f-af0a-91692422b32c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:34.557974 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cef1d612-9125-481f-af0a-91692422b32c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:34.559104 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cef1d612-9125-481f-af0a-91692422b32c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:34.559695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cef1d612-9125-481f-af0a-91692422b32c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:34.764990 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-cef1d612-9125-481f-af0a-91692422b32c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:34.774477 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-cef1d612-9125-481f-af0a-91692422b32c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.233660 Oct 28 08:46:34.775059 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 489/919] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:34 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:35.300763 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-77838289-8e6b-4a2f-8ada-7c3a6696583e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:35.301325 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-77838289-8e6b-4a2f-8ada-7c3a6696583e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:35.308158 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-77838289-8e6b-4a2f-8ada-7c3a6696583e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:35.308873 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-77838289-8e6b-4a2f-8ada-7c3a6696583e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:35.309673 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-77838289-8e6b-4a2f-8ada-7c3a6696583e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:35.310370 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-77838289-8e6b-4a2f-8ada-7c3a6696583e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:35.456581 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-77838289-8e6b-4a2f-8ada-7c3a6696583e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:35.466338 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-77838289-8e6b-4a2f-8ada-7c3a6696583e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:35.467677 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-77838289-8e6b-4a2f-8ada-7c3a6696583e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:35.469572 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-77838289-8e6b-4a2f-8ada-7c3a6696583e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1806 microversion: 2.20 time: 0.173496 Oct 28 08:46:35.470287 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 431/920] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:35 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:35.791926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b8e18949-3758-4ee3-8515-9472fe4e020c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:35.792504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b8e18949-3758-4ee3-8515-9472fe4e020c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:35.800107 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8e18949-3758-4ee3-8515-9472fe4e020c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:35.800664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8e18949-3758-4ee3-8515-9472fe4e020c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:35.801744 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8e18949-3758-4ee3-8515-9472fe4e020c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:35.802214 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8e18949-3758-4ee3-8515-9472fe4e020c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:35.957529 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b8e18949-3758-4ee3-8515-9472fe4e020c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:35.965504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b8e18949-3758-4ee3-8515-9472fe4e020c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.177173 Oct 28 08:46:35.966307 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 490/921] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:35 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:36.488950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ce1572f6-a769-4bea-aeb6-4216504b2007 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:36.489658 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ce1572f6-a769-4bea-aeb6-4216504b2007 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:36.495864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ce1572f6-a769-4bea-aeb6-4216504b2007 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:36.496313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ce1572f6-a769-4bea-aeb6-4216504b2007 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:36.497080 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ce1572f6-a769-4bea-aeb6-4216504b2007 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:36.497517 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ce1572f6-a769-4bea-aeb6-4216504b2007 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:36.635563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ce1572f6-a769-4bea-aeb6-4216504b2007 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:36.644229 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ce1572f6-a769-4bea-aeb6-4216504b2007 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:36.645716 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ce1572f6-a769-4bea-aeb6-4216504b2007 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:36.646888 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ce1572f6-a769-4bea-aeb6-4216504b2007 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1793 microversion: 2.20 time: 0.161801 Oct 28 08:46:36.647447 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 432/922] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:36 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1793 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:36.989031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c4300207-d6f8-4400-a660-bbf53b95e18c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:36.989511 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c4300207-d6f8-4400-a660-bbf53b95e18c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:36.995773 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c4300207-d6f8-4400-a660-bbf53b95e18c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:36.996217 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c4300207-d6f8-4400-a660-bbf53b95e18c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:36.996996 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c4300207-d6f8-4400-a660-bbf53b95e18c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:36.997427 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c4300207-d6f8-4400-a660-bbf53b95e18c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:37.123104 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c4300207-d6f8-4400-a660-bbf53b95e18c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:37.131313 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c4300207-d6f8-4400-a660-bbf53b95e18c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.146427 Oct 28 08:46:37.131876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 491/923] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:36 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:38.148615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-55df7d27-4968-475f-a33a-7b3cf14def4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:38.149252 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-55df7d27-4968-475f-a33a-7b3cf14def4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:38.157668 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-55df7d27-4968-475f-a33a-7b3cf14def4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:38.158129 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-55df7d27-4968-475f-a33a-7b3cf14def4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:38.158892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-55df7d27-4968-475f-a33a-7b3cf14def4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:38.159319 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-55df7d27-4968-475f-a33a-7b3cf14def4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:38.290618 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-55df7d27-4968-475f-a33a-7b3cf14def4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:38.298467 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-55df7d27-4968-475f-a33a-7b3cf14def4c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.153753 Oct 28 08:46:38.299042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 433/924] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:38 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:39.315095 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fd9c2d5a-4da0-4b18-bee2-cdbd846ca90d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:39.315783 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fd9c2d5a-4da0-4b18-bee2-cdbd846ca90d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:39.322549 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd9c2d5a-4da0-4b18-bee2-cdbd846ca90d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:39.323002 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd9c2d5a-4da0-4b18-bee2-cdbd846ca90d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:39.323825 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd9c2d5a-4da0-4b18-bee2-cdbd846ca90d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:39.324260 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fd9c2d5a-4da0-4b18-bee2-cdbd846ca90d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:39.453684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fd9c2d5a-4da0-4b18-bee2-cdbd846ca90d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:39.460975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fd9c2d5a-4da0-4b18-bee2-cdbd846ca90d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1677 microversion: 2.1 time: 0.149805 Oct 28 08:46:39.461536 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 492/925] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:39 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:40.445292 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:46:40.445958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: Thu Oct 28 08:46:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:46:40.478338 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-afa5b3a6-1f5a-4ccd-b587-cf67a7585ded tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:40.478955 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-afa5b3a6-1f5a-4ccd-b587-cf67a7585ded tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:40.486150 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-afa5b3a6-1f5a-4ccd-b587-cf67a7585ded tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:40.486883 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-afa5b3a6-1f5a-4ccd-b587-cf67a7585ded tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:40.488092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-afa5b3a6-1f5a-4ccd-b587-cf67a7585ded tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:40.488746 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-afa5b3a6-1f5a-4ccd-b587-cf67a7585ded tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:40.617809 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-afa5b3a6-1f5a-4ccd-b587-cf67a7585ded tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:40.626451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-afa5b3a6-1f5a-4ccd-b587-cf67a7585ded tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1654 microversion: 2.1 time: 0.151042 Oct 28 08:46:40.627035 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 434/926] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:40 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:40.643195 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b39da988-fd50-494b-98a4-f7bbbc8fa5dc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:46:40.649567 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b39da988-fd50-494b-98a4-f7bbbc8fa5dc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:40.650118 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b39da988-fd50-494b-98a4-f7bbbc8fa5dc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:40.673596 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b39da988-fd50-494b-98a4-f7bbbc8fa5dc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Going to try to start instance {{(pid=132797) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 08:46:40.717255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b39da988-fd50-494b-98a4-f7bbbc8fa5dc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action" status: 202 len: 0 microversion: 2.1 time: 0.078220 Oct 28 08:46:40.718030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 493/927] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:46:40 2021] POST /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:46:40.726899 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0d1278f4-543a-445b-b25a-1388947f136c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:40.727555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0d1278f4-543a-445b-b25a-1388947f136c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:40.733837 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d1278f4-543a-445b-b25a-1388947f136c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:40.734469 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d1278f4-543a-445b-b25a-1388947f136c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:40.735265 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d1278f4-543a-445b-b25a-1388947f136c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:40.735700 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0d1278f4-543a-445b-b25a-1388947f136c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:40.908089 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0d1278f4-543a-445b-b25a-1388947f136c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:40.916286 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0d1278f4-543a-445b-b25a-1388947f136c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1663 microversion: 2.1 time: 0.193169 Oct 28 08:46:40.917199 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 435/928] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:40 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1663 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:41.935646 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-66d187d4-800f-4693-a344-be245d357852 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:41.936424 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-66d187d4-800f-4693-a344-be245d357852 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:41.944526 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66d187d4-800f-4693-a344-be245d357852 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:41.944998 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66d187d4-800f-4693-a344-be245d357852 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:41.945779 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66d187d4-800f-4693-a344-be245d357852 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:41.946225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-66d187d4-800f-4693-a344-be245d357852 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:42.088069 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-66d187d4-800f-4693-a344-be245d357852 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:42.096200 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-66d187d4-800f-4693-a344-be245d357852 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1663 microversion: 2.1 time: 0.165332 Oct 28 08:46:42.096765 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 494/929] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:41 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:43.114410 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c72532cb-b4e1-4457-a839-741eccef1017 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:43.115051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c72532cb-b4e1-4457-a839-741eccef1017 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:43.121594 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c72532cb-b4e1-4457-a839-741eccef1017 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:43.122070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c72532cb-b4e1-4457-a839-741eccef1017 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:43.122849 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c72532cb-b4e1-4457-a839-741eccef1017 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:43.123269 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c72532cb-b4e1-4457-a839-741eccef1017 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:43.256776 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c72532cb-b4e1-4457-a839-741eccef1017 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:43.263940 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c72532cb-b4e1-4457-a839-741eccef1017 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1667 microversion: 2.1 time: 0.153216 Oct 28 08:46:43.264494 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 436/930] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:43 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:48.659305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c9a94359-a08a-4f3c-b723-706d27015570 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-886198110"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:46:48.659305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c9a94359-a08a-4f3c-b723-706d27015570 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:48.666285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c9a94359-a08a-4f3c-b723-706d27015570 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:48.666636 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c9a94359-a08a-4f3c-b723-706d27015570 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:48.667513 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c9a94359-a08a-4f3c-b723-706d27015570 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:48.667862 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c9a94359-a08a-4f3c-b723-706d27015570 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:48.794543 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.network.security_group_api [None req-c9a94359-a08a-4f3c-b723-706d27015570 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Removing security group 4cb6ddd4-447a-4a7f-bc35-00f119c992ee from port 760c9603-2fe5-4dc3-aa4c-7ff255fee93d Oct 28 08:46:49.162876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c9a94359-a08a-4f3c-b723-706d27015570 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "POST /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/action" status: 202 len: 0 microversion: 2.1 time: 0.692042 Oct 28 08:46:49.168503 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 495/931] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:46:48 2021] POST /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:46:49.292345 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-9f4998a1-76ef-4009-a871-c13b86938238 req-e65b5d1b-d68f-48cd-9f3c-e36c2245919d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50b0126-b6b3-4fbf-8596-0f7b3d5877f6", "tag": "760c9603-2fe5-4dc3-aa4c-7ff255fee93d"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:46:49.296222 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:46:49.296222 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:46:49.306105 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-9f4998a1-76ef-4009-a871-c13b86938238 req-e65b5d1b-d68f-48cd-9f3c-e36c2245919d service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:49.306720 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-9f4998a1-76ef-4009-a871-c13b86938238 req-e65b5d1b-d68f-48cd-9f3c-e36c2245919d service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:49.341139 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-9f4998a1-76ef-4009-a871-c13b86938238 req-e65b5d1b-d68f-48cd-9f3c-e36c2245919d service nova] Creating event network-changed:760c9603-2fe5-4dc3-aa4c-7ff255fee93d for instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 on hv-cinder-81566 Oct 28 08:46:49.352751 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-9f4998a1-76ef-4009-a871-c13b86938238 req-e65b5d1b-d68f-48cd-9f3c-e36c2245919d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181841 Oct 28 08:46:49.354073 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 437/932] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:46:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:46:51.240679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-be340866-8ccd-4ded-b3ad-652aee3268f6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:51.241282 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-be340866-8ccd-4ded-b3ad-652aee3268f6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:51.247137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be340866-8ccd-4ded-b3ad-652aee3268f6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:51.247583 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be340866-8ccd-4ded-b3ad-652aee3268f6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:51.248380 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be340866-8ccd-4ded-b3ad-652aee3268f6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:51.248811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-be340866-8ccd-4ded-b3ad-652aee3268f6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:51.335588 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-be340866-8ccd-4ded-b3ad-652aee3268f6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lazy-loading 'services' on Instance uuid b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:46:51.377405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-de813534-1a1d-4fd5-96ad-27c85df376cb req-ecb07de1-78e7-47da-9efb-1cbbf20f8168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50b0126-b6b3-4fbf-8596-0f7b3d5877f6", "tag": "760c9603-2fe5-4dc3-aa4c-7ff255fee93d"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:46:51.379743 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:46:51.379743 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:46:51.390409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-de813534-1a1d-4fd5-96ad-27c85df376cb req-ecb07de1-78e7-47da-9efb-1cbbf20f8168 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:51.391217 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-de813534-1a1d-4fd5-96ad-27c85df376cb req-ecb07de1-78e7-47da-9efb-1cbbf20f8168 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:51.405442 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-de813534-1a1d-4fd5-96ad-27c85df376cb req-ecb07de1-78e7-47da-9efb-1cbbf20f8168 service nova] Creating event network-changed:760c9603-2fe5-4dc3-aa4c-7ff255fee93d for instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 on hv-cinder-81566 Oct 28 08:46:51.421107 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-de813534-1a1d-4fd5-96ad-27c85df376cb req-ecb07de1-78e7-47da-9efb-1cbbf20f8168 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043146 Oct 28 08:46:51.423093 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 438/933] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:46:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:46:51.424631 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-be340866-8ccd-4ded-b3ad-652aee3268f6 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "DELETE /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments/484cb76b-4a59-48cf-bf3c-ba97f486e8e8" status: 202 len: 0 microversion: 2.1 time: 0.187924 Oct 28 08:46:51.426315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 496/934] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:46:51 2021] DELETE /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments/484cb76b-4a59-48cf-bf3c-ba97f486e8e8 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:46:51.434850 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7465a33c-fb59-4a17-8dd1-1fa85fe78714 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:51.436665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7465a33c-fb59-4a17-8dd1-1fa85fe78714 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:51.445536 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7465a33c-fb59-4a17-8dd1-1fa85fe78714 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:51.446364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7465a33c-fb59-4a17-8dd1-1fa85fe78714 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:51.447517 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7465a33c-fb59-4a17-8dd1-1fa85fe78714 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:51.448289 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7465a33c-fb59-4a17-8dd1-1fa85fe78714 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:51.491318 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7465a33c-fb59-4a17-8dd1-1fa85fe78714 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061345 Oct 28 08:46:51.492099 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 439/935] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:46:51 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:46:52.505136 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ff51ce7e-f6dd-4c70-b865-fbe405f8e438 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:52.506803 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ff51ce7e-f6dd-4c70-b865-fbe405f8e438 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:52.513554 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ff51ce7e-f6dd-4c70-b865-fbe405f8e438 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:52.516254 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ff51ce7e-f6dd-4c70-b865-fbe405f8e438 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:52.517549 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ff51ce7e-f6dd-4c70-b865-fbe405f8e438 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:52.518253 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ff51ce7e-f6dd-4c70-b865-fbe405f8e438 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:52.552602 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ff51ce7e-f6dd-4c70-b865-fbe405f8e438 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052772 Oct 28 08:46:52.553234 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 497/936] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:46:52 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:46:53.565751 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9fda8dcf-dde9-4b97-91b7-1f499844e62c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:53.567106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9fda8dcf-dde9-4b97-91b7-1f499844e62c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:53.575398 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9fda8dcf-dde9-4b97-91b7-1f499844e62c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:53.575876 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9fda8dcf-dde9-4b97-91b7-1f499844e62c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:53.576656 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9fda8dcf-dde9-4b97-91b7-1f499844e62c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:53.577091 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9fda8dcf-dde9-4b97-91b7-1f499844e62c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:53.606266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9fda8dcf-dde9-4b97-91b7-1f499844e62c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Oct 28 08:46:53.606844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 440/937] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:46:53 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:46:54.618621 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-209b9261-b6b0-4da0-935e-d2ab181ef127 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:54.619450 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-209b9261-b6b0-4da0-935e-d2ab181ef127 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:54.626780 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-209b9261-b6b0-4da0-935e-d2ab181ef127 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:54.627230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-209b9261-b6b0-4da0-935e-d2ab181ef127 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:54.628070 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-209b9261-b6b0-4da0-935e-d2ab181ef127 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:54.628510 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-209b9261-b6b0-4da0-935e-d2ab181ef127 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:54.663153 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-209b9261-b6b0-4da0-935e-d2ab181ef127 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048260 Oct 28 08:46:54.663745 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 498/938] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:46:54 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:46:55.674924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bb17c9de-3295-4fa3-bea6-b67b14e318d5 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:55.675745 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bb17c9de-3295-4fa3-bea6-b67b14e318d5 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:55.682214 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bb17c9de-3295-4fa3-bea6-b67b14e318d5 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:55.682660 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bb17c9de-3295-4fa3-bea6-b67b14e318d5 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:55.683432 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bb17c9de-3295-4fa3-bea6-b67b14e318d5 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:55.683863 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bb17c9de-3295-4fa3-bea6-b67b14e318d5 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:55.720804 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bb17c9de-3295-4fa3-bea6-b67b14e318d5 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049672 Oct 28 08:46:55.721369 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 441/939] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:46:55 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:46:56.732460 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fb74f480-a70a-4c53-851c-a94ea6f5953e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:56.733415 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fb74f480-a70a-4c53-851c-a94ea6f5953e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:56.740490 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb74f480-a70a-4c53-851c-a94ea6f5953e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:56.740932 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb74f480-a70a-4c53-851c-a94ea6f5953e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:56.741709 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb74f480-a70a-4c53-851c-a94ea6f5953e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:56.742161 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb74f480-a70a-4c53-851c-a94ea6f5953e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:56.779435 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fb74f480-a70a-4c53-851c-a94ea6f5953e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050722 Oct 28 08:46:56.780007 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 499/940] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:46:56 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:46:57.792472 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-274079a1-9e03-4ef0-bae1-5f980304b96f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:57.793440 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-274079a1-9e03-4ef0-bae1-5f980304b96f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:57.801024 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-274079a1-9e03-4ef0-bae1-5f980304b96f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:57.801459 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-274079a1-9e03-4ef0-bae1-5f980304b96f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:57.802272 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-274079a1-9e03-4ef0-bae1-5f980304b96f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:57.802684 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-274079a1-9e03-4ef0-bae1-5f980304b96f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:57.832671 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-274079a1-9e03-4ef0-bae1-5f980304b96f tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044090 Oct 28 08:46:57.833243 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 442/941] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:46:57 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:46:57.843106 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a0b1faf2-b83c-4694-8e19-dd092bcc982e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:57.843767 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a0b1faf2-b83c-4694-8e19-dd092bcc982e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:57.850071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0b1faf2-b83c-4694-8e19-dd092bcc982e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:57.850505 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0b1faf2-b83c-4694-8e19-dd092bcc982e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:57.851266 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0b1faf2-b83c-4694-8e19-dd092bcc982e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:57.851688 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a0b1faf2-b83c-4694-8e19-dd092bcc982e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:57.933681 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-a0b1faf2-b83c-4694-8e19-dd092bcc982e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] HTTP exception thrown: Instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 is not attached to volume 484cb76b-4a59-48cf-bf3c-ba97f486e8e8 Oct 28 08:46:57.934334 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a0b1faf2-b83c-4694-8e19-dd092bcc982e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Returning 404 to user: Instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 is not attached to volume 484cb76b-4a59-48cf-bf3c-ba97f486e8e8 {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:46:57.935187 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a0b1faf2-b83c-4694-8e19-dd092bcc982e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "DELETE /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments/484cb76b-4a59-48cf-bf3c-ba97f486e8e8" status: 404 len: 154 microversion: 2.1 time: 0.096019 Oct 28 08:46:57.935755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 500/942] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:46:57 2021] DELETE /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6/os-volume_attachments/484cb76b-4a59-48cf-bf3c-ba97f486e8e8 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:46:59.073099 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-99069fec-c827-46cc-a790-83ffb6ff112e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:59.073595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-99069fec-c827-46cc-a790-83ffb6ff112e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:59.080111 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-99069fec-c827-46cc-a790-83ffb6ff112e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:59.080562 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-99069fec-c827-46cc-a790-83ffb6ff112e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:59.081338 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-99069fec-c827-46cc-a790-83ffb6ff112e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:59.081892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-99069fec-c827-46cc-a790-83ffb6ff112e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:59.109660 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-99069fec-c827-46cc-a790-83ffb6ff112e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:46:59.185860 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-99069fec-c827-46cc-a790-83ffb6ff112e tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "DELETE /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 204 len: 0 microversion: 2.1 time: 0.115910 Oct 28 08:46:59.186638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 443/943] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:46:59 2021] DELETE /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:46:59.194748 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f0640298-a32b-49fa-90e2-94bad2c8b04c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:59.195588 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f0640298-a32b-49fa-90e2-94bad2c8b04c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:59.204610 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f0640298-a32b-49fa-90e2-94bad2c8b04c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:59.205061 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f0640298-a32b-49fa-90e2-94bad2c8b04c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:59.205886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f0640298-a32b-49fa-90e2-94bad2c8b04c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:59.206318 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f0640298-a32b-49fa-90e2-94bad2c8b04c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:59.336087 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f0640298-a32b-49fa-90e2-94bad2c8b04c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:59.344109 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f0640298-a32b-49fa-90e2-94bad2c8b04c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1556 microversion: 2.1 time: 0.152459 Oct 28 08:46:59.344678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 501/944] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:59 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:00.362908 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8ca2eb5a-13e1-4ea9-81fc-de4326cb7ad9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:00.363697 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8ca2eb5a-13e1-4ea9-81fc-de4326cb7ad9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:00.370045 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8ca2eb5a-13e1-4ea9-81fc-de4326cb7ad9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:00.370493 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8ca2eb5a-13e1-4ea9-81fc-de4326cb7ad9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:00.371257 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8ca2eb5a-13e1-4ea9-81fc-de4326cb7ad9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:00.371689 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8ca2eb5a-13e1-4ea9-81fc-de4326cb7ad9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:00.518247 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8ca2eb5a-13e1-4ea9-81fc-de4326cb7ad9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:00.525496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8ca2eb5a-13e1-4ea9-81fc-de4326cb7ad9 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1556 microversion: 2.1 time: 0.167511 Oct 28 08:47:00.526088 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 444/945] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:00 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:01.543594 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d365d502-b3df-4911-b919-ca39cf06865c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:01.544204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d365d502-b3df-4911-b919-ca39cf06865c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:01.551172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d365d502-b3df-4911-b919-ca39cf06865c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:01.551626 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d365d502-b3df-4911-b919-ca39cf06865c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:01.552398 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d365d502-b3df-4911-b919-ca39cf06865c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:01.552827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d365d502-b3df-4911-b919-ca39cf06865c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:01.745447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d365d502-b3df-4911-b919-ca39cf06865c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26549afb955447738168904a2c2a716b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6091e93f804ac3b925a7b3e9f3c747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:01.754085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d365d502-b3df-4911-b919-ca39cf06865c tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 200 len: 1556 microversion: 2.1 time: 0.214082 Oct 28 08:47:01.754666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 502/946] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:01 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:02.148684 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-6bc6afa8-824f-4036-b941-48061abd9f0c req-b765bac5-e120-4600-bda8-eeb38558b4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50b0126-b6b3-4fbf-8596-0f7b3d5877f6", "name": "network-vif-deleted", "tag": "760c9603-2fe5-4dc3-aa4c-7ff255fee93d"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:02.150227 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:47:02.150227 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:47:02.158475 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-6bc6afa8-824f-4036-b941-48061abd9f0c req-b765bac5-e120-4600-bda8-eeb38558b4a4 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:02.158920 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-6bc6afa8-824f-4036-b941-48061abd9f0c req-b765bac5-e120-4600-bda8-eeb38558b4a4 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:02.173158 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-6bc6afa8-824f-4036-b941-48061abd9f0c req-b765bac5-e120-4600-bda8-eeb38558b4a4 service nova] Creating event network-vif-deleted:760c9603-2fe5-4dc3-aa4c-7ff255fee93d for instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 on hv-cinder-81566 Oct 28 08:47:02.178070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-6bc6afa8-824f-4036-b941-48061abd9f0c req-b765bac5-e120-4600-bda8-eeb38558b4a4 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032889 Oct 28 08:47:02.178604 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 445/947] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:47:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:47:02.770876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c4630b86-9538-4852-9ef8-c96e4d37f6a8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:02.771485 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c4630b86-9538-4852-9ef8-c96e4d37f6a8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] [instance: b50b0126-b6b3-4fbf-8596-0f7b3d5877f6] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:02.777916 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c4630b86-9538-4852-9ef8-c96e4d37f6a8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:02.778369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c4630b86-9538-4852-9ef8-c96e4d37f6a8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:02.786467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c4630b86-9538-4852-9ef8-c96e4d37f6a8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:02.786467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c4630b86-9538-4852-9ef8-c96e4d37f6a8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:02.795471 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-c4630b86-9538-4852-9ef8-c96e4d37f6a8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] HTTP exception thrown: Instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 could not be found. Oct 28 08:47:02.796105 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c4630b86-9538-4852-9ef8-c96e4d37f6a8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Returning 404 to user: Instance b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:47:02.798045 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c4630b86-9538-4852-9ef8-c96e4d37f6a8 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6" status: 404 len: 111 microversion: 2.1 time: 0.030671 Oct 28 08:47:02.799287 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 503/948] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:02 2021] GET /compute/v2.1/servers/b50b0126-b6b3-4fbf-8596-0f7b3d5877f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:47:02.808095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6d2c3c27-3f13-40d9-b9f7-ed033cdae098 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] Calling method '.version_select at 0x7f9e6bff0700>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:02.831626 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6d2c3c27-3f13-40d9-b9f7-ed033cdae098 tempest-TestMinimumBasicScenario-1324789815 tempest-TestMinimumBasicScenario-1324789815-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1600299402" status: 202 len: 0 microversion: 2.1 time: 0.027525 Oct 28 08:47:02.833131 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 446/949] 10.222.0.74 () {58 vars in 1271 bytes} [Thu Oct 28 08:47:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1600299402 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:47:20.211678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6d34c4fa-31b9-4387-af32-9d6dc9a96538 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:20.213036 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6d34c4fa-31b9-4387-af32-9d6dc9a96538 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:20.223929 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d34c4fa-31b9-4387-af32-9d6dc9a96538 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:20.224972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d34c4fa-31b9-4387-af32-9d6dc9a96538 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:20.226426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d34c4fa-31b9-4387-af32-9d6dc9a96538 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:20.226933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6d34c4fa-31b9-4387-af32-9d6dc9a96538 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:20.290724 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6d34c4fa-31b9-4387-af32-9d6dc9a96538 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Going to try to terminate instance {{(pid=132797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:47:20.458410 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6d34c4fa-31b9-4387-af32-9d6dc9a96538 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "DELETE /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 204 len: 0 microversion: 2.1 time: 0.250303 Oct 28 08:47:20.462544 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 504/950] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:47:20 2021] DELETE /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:47:20.468990 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-daacd2df-4519-46b2-9cbe-bf5885341108 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:20.471294 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-daacd2df-4519-46b2-9cbe-bf5885341108 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:20.480196 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-daacd2df-4519-46b2-9cbe-bf5885341108 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:20.480811 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-daacd2df-4519-46b2-9cbe-bf5885341108 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:20.487328 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-daacd2df-4519-46b2-9cbe-bf5885341108 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:20.487973 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-daacd2df-4519-46b2-9cbe-bf5885341108 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:20.813073 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-daacd2df-4519-46b2-9cbe-bf5885341108 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:20.825192 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-daacd2df-4519-46b2-9cbe-bf5885341108 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1576 microversion: 2.1 time: 0.360862 Oct 28 08:47:20.828608 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 447/951] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:20 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1576 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:21.847419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a5228981-203a-49d6-9118-3a372d9772df tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:21.850255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a5228981-203a-49d6-9118-3a372d9772df tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:21.858400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a5228981-203a-49d6-9118-3a372d9772df tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:21.860927 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a5228981-203a-49d6-9118-3a372d9772df tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:21.861881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a5228981-203a-49d6-9118-3a372d9772df tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:21.864077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a5228981-203a-49d6-9118-3a372d9772df tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:22.622982 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a5228981-203a-49d6-9118-3a372d9772df tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:22.639944 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a5228981-203a-49d6-9118-3a372d9772df tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1576 microversion: 2.1 time: 0.798803 Oct 28 08:47:22.649552 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 505/952] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:21 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1576 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:23.008055 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8bd724fc-aeb8-4f86-b75f-3f10763ea182 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Action: 'create', calling method: .version_select at 0x7f9e6bff04c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2050932582"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:23.040161 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-8bd724fc-aeb8-4f86-b75f-3f10763ea182 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Getting quotas for project d66afaa2b9f04ea1a518ab92aab8cb1d. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:47:23.044963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-8bd724fc-aeb8-4f86-b75f-3f10763ea182 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Getting quotas for user 4327173547b5425a9e4823c883298ecf and project d66afaa2b9f04ea1a518ab92aab8cb1d. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:47:23.192985 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-8bd724fc-aeb8-4f86-b75f-3f10763ea182 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Getting quotas for project d66afaa2b9f04ea1a518ab92aab8cb1d. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:47:23.198427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-8bd724fc-aeb8-4f86-b75f-3f10763ea182 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Getting quotas for user 4327173547b5425a9e4823c883298ecf and project d66afaa2b9f04ea1a518ab92aab8cb1d. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:47:23.217296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8bd724fc-aeb8-4f86-b75f-3f10763ea182 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.470356 Oct 28 08:47:23.220401 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 448/953] 10.222.0.74 () {60 vars in 1157 bytes} [Thu Oct 28 08:47:22 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:23.670436 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5317f7c0-d005-45a6-8533-23d634694c54 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:23.670859 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5317f7c0-d005-45a6-8533-23d634694c54 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:23.687513 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5317f7c0-d005-45a6-8533-23d634694c54 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:23.688310 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5317f7c0-d005-45a6-8533-23d634694c54 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:23.689174 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5317f7c0-d005-45a6-8533-23d634694c54 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:23.689639 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5317f7c0-d005-45a6-8533-23d634694c54 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:23.835708 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-eab49cf0-d1f9-4b0a-9b7f-6db17c58ef88 req-4ef3def3-04fa-4e95-854f-be9b79057214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1aa424-5de3-486c-af93-d2e0b411fa1a", "name": "network-vif-deleted", "tag": "da56e668-59c2-40dc-8745-6f9ac628122a"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:23.840819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:47:23.840819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:47:23.879878 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-eab49cf0-d1f9-4b0a-9b7f-6db17c58ef88 req-4ef3def3-04fa-4e95-854f-be9b79057214 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:23.880330 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-eab49cf0-d1f9-4b0a-9b7f-6db17c58ef88 req-4ef3def3-04fa-4e95-854f-be9b79057214 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:23.900423 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-eab49cf0-d1f9-4b0a-9b7f-6db17c58ef88 req-4ef3def3-04fa-4e95-854f-be9b79057214 service nova] Creating event network-vif-deleted:da56e668-59c2-40dc-8745-6f9ac628122a for instance 5d1aa424-5de3-486c-af93-d2e0b411fa1a on hv-cinder-81566 Oct 28 08:47:23.908502 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-eab49cf0-d1f9-4b0a-9b7f-6db17c58ef88 req-4ef3def3-04fa-4e95-854f-be9b79057214 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076897 Oct 28 08:47:23.909844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 449/954] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:47:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:47:23.943654 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5317f7c0-d005-45a6-8533-23d634694c54 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:23.951833 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5317f7c0-d005-45a6-8533-23d634694c54 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 200 len: 1508 microversion: 2.1 time: 0.286963 Oct 28 08:47:23.952414 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 506/955] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:23 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 1508 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:24.970806 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0f0f679f-28fa-4b38-8733-fe94b76aae60 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:24.971485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0f0f679f-28fa-4b38-8733-fe94b76aae60 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:24.978191 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f0f679f-28fa-4b38-8733-fe94b76aae60 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:24.978637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f0f679f-28fa-4b38-8733-fe94b76aae60 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:24.979539 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f0f679f-28fa-4b38-8733-fe94b76aae60 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:24.980117 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f0f679f-28fa-4b38-8733-fe94b76aae60 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:24.996061 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-0f0f679f-28fa-4b38-8733-fe94b76aae60 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] HTTP exception thrown: Instance 5d1aa424-5de3-486c-af93-d2e0b411fa1a could not be found. Oct 28 08:47:24.996674 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0f0f679f-28fa-4b38-8733-fe94b76aae60 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Returning 404 to user: Instance 5d1aa424-5de3-486c-af93-d2e0b411fa1a could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:47:24.997511 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0f0f679f-28fa-4b38-8733-fe94b76aae60 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 404 len: 111 microversion: 2.1 time: 0.031660 Oct 28 08:47:25.005708 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 450/956] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:24 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:47:25.115474 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1913770131", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-21201921", "security_groups": [{"name": "tempest-secgroup-smoke-1557192688"}], "block_device_mapping_v2": [{"uuid": "9304ef6e-fbcf-46c0-ae05-14ad8ac6652b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c4e2068-440b-4c5b-b064-f6b110ee163c"}]}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:25.227200 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.network.neutron [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] validate_networks() for [('5c4e2068-440b-4c5b-b064-f6b110ee163c', None, None, None, None, None)] {{(pid=132797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:47:25.686816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Flavor limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:47:25.691904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Image limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:47:25.692778 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Flavor pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:47:25.693434 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Image pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:47:25.694079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:47:25.711814 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:25.712273 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:25.713066 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:25.713487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:25.730914 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Getting quotas for project 3f8be4e851fc4c5bb989b23068ab50b0. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:47:25.737166 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Getting quotas for user c731f20a04204d9ea0b04a20f2e72577 and project 3f8be4e851fc4c5bb989b23068ab50b0. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:47:25.816054 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Going to run 1 instances... {{(pid=132797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:47:25.818700 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9304ef6e-fbcf-46c0-ae05-14ad8ac6652b',volume_size=None,volume_type=None)] {{(pid=132797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:47:25.967490 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7bfd6266-41f2-41f7-b46b-4d7c92f0a0a6 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.857885 Oct 28 08:47:25.968321 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 507/957] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:47:25 2021] POST /compute/v2.1/servers => generated 406 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:47:25.979131 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-162f213a-8852-4031-b0da-649564440525 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:25.980465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-162f213a-8852-4031-b0da-649564440525 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:26.066368 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-162f213a-8852-4031-b0da-649564440525 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:26.081609 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-162f213a-8852-4031-b0da-649564440525 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1093 microversion: 2.1 time: 0.106205 Oct 28 08:47:26.094103 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 451/958] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:25 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1093 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:27.103286 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9adda09d-c456-431e-aa64-b9d036df7d4c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:27.104953 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9adda09d-c456-431e-aa64-b9d036df7d4c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:27.123508 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9adda09d-c456-431e-aa64-b9d036df7d4c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:27.124567 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9adda09d-c456-431e-aa64-b9d036df7d4c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:27.125704 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9adda09d-c456-431e-aa64-b9d036df7d4c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:27.126455 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9adda09d-c456-431e-aa64-b9d036df7d4c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:27.210240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9adda09d-c456-431e-aa64-b9d036df7d4c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:27.220566 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9adda09d-c456-431e-aa64-b9d036df7d4c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1209 microversion: 2.1 time: 0.119189 Oct 28 08:47:27.222495 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 508/959] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:27 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1209 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:28.242741 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-51651df0-05bb-43b0-9472-8ab7e8be3a43 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:28.243412 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-51651df0-05bb-43b0-9472-8ab7e8be3a43 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:28.254846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-51651df0-05bb-43b0-9472-8ab7e8be3a43 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:28.255577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-51651df0-05bb-43b0-9472-8ab7e8be3a43 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:28.256682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-51651df0-05bb-43b0-9472-8ab7e8be3a43 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:28.257280 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-51651df0-05bb-43b0-9472-8ab7e8be3a43 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:28.463993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-51651df0-05bb-43b0-9472-8ab7e8be3a43 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:28.471920 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-51651df0-05bb-43b0-9472-8ab7e8be3a43 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.235697 Oct 28 08:47:28.472593 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 452/960] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:28 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:28.746904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-d3293669-736e-402b-9a0e-34411368b726 req-11a5d70b-3f78-4d41-b185-3c01759a8eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e1be19-0a03-4c39-a83c-6003d4bd42d3", "tag": "fc95f307-8716-45cd-991e-6a984816ab3c"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:28.749420 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:47:28.749420 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:47:28.789326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-d3293669-736e-402b-9a0e-34411368b726 req-11a5d70b-3f78-4d41-b185-3c01759a8eb5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:28.791345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-d3293669-736e-402b-9a0e-34411368b726 req-11a5d70b-3f78-4d41-b185-3c01759a8eb5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:28.804134 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-d3293669-736e-402b-9a0e-34411368b726 req-11a5d70b-3f78-4d41-b185-3c01759a8eb5 service nova] Creating event network-changed:fc95f307-8716-45cd-991e-6a984816ab3c for instance 82e1be19-0a03-4c39-a83c-6003d4bd42d3 on hv-cinder-81566 Oct 28 08:47:28.811960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-d3293669-736e-402b-9a0e-34411368b726 req-11a5d70b-3f78-4d41-b185-3c01759a8eb5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070412 Oct 28 08:47:28.813108 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 509/961] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:47:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:47:29.489025 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-aae6e280-0187-4785-a27c-cd663ec3b9a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:29.489620 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-aae6e280-0187-4785-a27c-cd663ec3b9a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:29.496389 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aae6e280-0187-4785-a27c-cd663ec3b9a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:29.496897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aae6e280-0187-4785-a27c-cd663ec3b9a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:29.497675 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aae6e280-0187-4785-a27c-cd663ec3b9a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:29.498189 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aae6e280-0187-4785-a27c-cd663ec3b9a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:29.728687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aae6e280-0187-4785-a27c-cd663ec3b9a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:29.736614 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-aae6e280-0187-4785-a27c-cd663ec3b9a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.251882 Oct 28 08:47:29.737200 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 453/962] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:29 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:30.754802 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ef72d711-7738-4ad9-9c66-b56dc851e719 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:30.755532 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ef72d711-7738-4ad9-9c66-b56dc851e719 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:30.761604 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ef72d711-7738-4ad9-9c66-b56dc851e719 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:30.762082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ef72d711-7738-4ad9-9c66-b56dc851e719 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:30.762857 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ef72d711-7738-4ad9-9c66-b56dc851e719 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:30.763291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ef72d711-7738-4ad9-9c66-b56dc851e719 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:30.909331 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ef72d711-7738-4ad9-9c66-b56dc851e719 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:30.916643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ef72d711-7738-4ad9-9c66-b56dc851e719 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.166500 Oct 28 08:47:30.917211 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 510/963] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:30 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:31.934098 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2a3fe30e-3a8b-447a-874c-82d9491afeb4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:31.934813 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2a3fe30e-3a8b-447a-874c-82d9491afeb4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:31.941970 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2a3fe30e-3a8b-447a-874c-82d9491afeb4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:31.942356 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2a3fe30e-3a8b-447a-874c-82d9491afeb4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:31.943126 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2a3fe30e-3a8b-447a-874c-82d9491afeb4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:31.943558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2a3fe30e-3a8b-447a-874c-82d9491afeb4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:32.072300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-2a3fe30e-3a8b-447a-874c-82d9491afeb4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:32.080416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2a3fe30e-3a8b-447a-874c-82d9491afeb4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.149966 Oct 28 08:47:32.080983 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 454/964] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:31 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:33.097007 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5c70b21c-e079-4986-99df-655da87850fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:33.097622 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5c70b21c-e079-4986-99df-655da87850fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:33.103921 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c70b21c-e079-4986-99df-655da87850fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:33.104390 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c70b21c-e079-4986-99df-655da87850fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:33.105160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c70b21c-e079-4986-99df-655da87850fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:33.105589 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c70b21c-e079-4986-99df-655da87850fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:33.232853 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5c70b21c-e079-4986-99df-655da87850fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:33.241924 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5c70b21c-e079-4986-99df-655da87850fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.148612 Oct 28 08:47:33.242502 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 511/965] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:33 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:34.259456 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-38e19280-db6a-4162-a970-bc3f0c672d21 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:34.260076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-38e19280-db6a-4162-a970-bc3f0c672d21 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:34.267582 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38e19280-db6a-4162-a970-bc3f0c672d21 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:34.268024 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38e19280-db6a-4162-a970-bc3f0c672d21 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:34.268796 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38e19280-db6a-4162-a970-bc3f0c672d21 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:34.269226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38e19280-db6a-4162-a970-bc3f0c672d21 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:34.399921 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-38e19280-db6a-4162-a970-bc3f0c672d21 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:34.408729 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-38e19280-db6a-4162-a970-bc3f0c672d21 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.152963 Oct 28 08:47:34.409298 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 455/966] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:34 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:35.426174 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f9b6c678-f8e9-4f74-bb11-23ec656948ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:35.426735 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f9b6c678-f8e9-4f74-bb11-23ec656948ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:35.432824 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9b6c678-f8e9-4f74-bb11-23ec656948ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:35.433264 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9b6c678-f8e9-4f74-bb11-23ec656948ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:35.434120 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9b6c678-f8e9-4f74-bb11-23ec656948ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:35.434548 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9b6c678-f8e9-4f74-bb11-23ec656948ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:35.562560 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f9b6c678-f8e9-4f74-bb11-23ec656948ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:35.570721 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f9b6c678-f8e9-4f74-bb11-23ec656948ad tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.148705 Oct 28 08:47:35.571640 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 512/967] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:35 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:36.588488 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-679e94d4-3dee-40d0-a6a2-6f7ebb27a732 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:36.589148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-679e94d4-3dee-40d0-a6a2-6f7ebb27a732 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:36.596378 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-679e94d4-3dee-40d0-a6a2-6f7ebb27a732 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:36.596823 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-679e94d4-3dee-40d0-a6a2-6f7ebb27a732 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:36.597609 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-679e94d4-3dee-40d0-a6a2-6f7ebb27a732 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:36.598075 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-679e94d4-3dee-40d0-a6a2-6f7ebb27a732 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:36.730539 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-679e94d4-3dee-40d0-a6a2-6f7ebb27a732 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:36.738607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-679e94d4-3dee-40d0-a6a2-6f7ebb27a732 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.153962 Oct 28 08:47:36.739189 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 456/968] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:36 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:37.757445 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-efafad22-4773-45d1-8ebc-1a3f34444ae0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:37.758093 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-efafad22-4773-45d1-8ebc-1a3f34444ae0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:37.764461 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-efafad22-4773-45d1-8ebc-1a3f34444ae0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:37.764904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-efafad22-4773-45d1-8ebc-1a3f34444ae0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:37.766379 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-efafad22-4773-45d1-8ebc-1a3f34444ae0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:37.767085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-efafad22-4773-45d1-8ebc-1a3f34444ae0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:37.894466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-efafad22-4773-45d1-8ebc-1a3f34444ae0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:37.902226 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-efafad22-4773-45d1-8ebc-1a3f34444ae0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.149210 Oct 28 08:47:37.902794 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 513/969] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:37 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:38.766698 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-00afbb3d-c957-4243-be1b-de60ed3a305f req-80a18654-2c62-4c02-a4a5-b7caad9e2cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e1be19-0a03-4c39-a83c-6003d4bd42d3", "name": "network-vif-plugged", "status": "completed", "tag": "fc95f307-8716-45cd-991e-6a984816ab3c"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:38.768199 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:47:38.768199 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:47:38.775783 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-00afbb3d-c957-4243-be1b-de60ed3a305f req-80a18654-2c62-4c02-a4a5-b7caad9e2cb6 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:38.776460 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-00afbb3d-c957-4243-be1b-de60ed3a305f req-80a18654-2c62-4c02-a4a5-b7caad9e2cb6 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:38.789517 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-00afbb3d-c957-4243-be1b-de60ed3a305f req-80a18654-2c62-4c02-a4a5-b7caad9e2cb6 service nova] Creating event network-vif-plugged:fc95f307-8716-45cd-991e-6a984816ab3c for instance 82e1be19-0a03-4c39-a83c-6003d4bd42d3 on hv-cinder-81566 Oct 28 08:47:38.795022 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-00afbb3d-c957-4243-be1b-de60ed3a305f req-80a18654-2c62-4c02-a4a5-b7caad9e2cb6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032517 Oct 28 08:47:38.795629 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 457/970] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:47:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:47:38.920593 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fdf5e098-e52a-4665-ba8c-28f4f5fc09dc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:38.921136 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fdf5e098-e52a-4665-ba8c-28f4f5fc09dc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:38.927561 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fdf5e098-e52a-4665-ba8c-28f4f5fc09dc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:38.928015 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fdf5e098-e52a-4665-ba8c-28f4f5fc09dc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:38.928821 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fdf5e098-e52a-4665-ba8c-28f4f5fc09dc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:38.929262 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fdf5e098-e52a-4665-ba8c-28f4f5fc09dc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:39.114439 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fdf5e098-e52a-4665-ba8c-28f4f5fc09dc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:39.121674 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fdf5e098-e52a-4665-ba8c-28f4f5fc09dc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.205141 Oct 28 08:47:39.122296 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 514/971] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:38 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:40.138607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-65a2a769-ab16-461e-995a-cd5d9adad320 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:40.139295 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-65a2a769-ab16-461e-995a-cd5d9adad320 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:40.146639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65a2a769-ab16-461e-995a-cd5d9adad320 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:40.147085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65a2a769-ab16-461e-995a-cd5d9adad320 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:40.147897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65a2a769-ab16-461e-995a-cd5d9adad320 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:40.148329 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65a2a769-ab16-461e-995a-cd5d9adad320 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:40.278817 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-65a2a769-ab16-461e-995a-cd5d9adad320 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:40.286795 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-65a2a769-ab16-461e-995a-cd5d9adad320 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1265 microversion: 2.1 time: 0.152670 Oct 28 08:47:40.287390 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 458/972] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:40 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:41.303651 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-992e0f2c-252f-4509-85d0-68fb64b79a12 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:41.304257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-992e0f2c-252f-4509-85d0-68fb64b79a12 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:41.310514 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-992e0f2c-252f-4509-85d0-68fb64b79a12 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:41.310962 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-992e0f2c-252f-4509-85d0-68fb64b79a12 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:41.311755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-992e0f2c-252f-4509-85d0-68fb64b79a12 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:41.312194 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-992e0f2c-252f-4509-85d0-68fb64b79a12 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:41.436522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-992e0f2c-252f-4509-85d0-68fb64b79a12 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:41.445015 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-992e0f2c-252f-4509-85d0-68fb64b79a12 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1452 microversion: 2.1 time: 0.144929 Oct 28 08:47:41.445598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 515/973] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:41 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:41.463368 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6f1bae10-a6ee-4ba4-8995-a8171160196c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:41.463957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6f1bae10-a6ee-4ba4-8995-a8171160196c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:41.470996 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f1bae10-a6ee-4ba4-8995-a8171160196c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:41.471444 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f1bae10-a6ee-4ba4-8995-a8171160196c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:41.472223 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f1bae10-a6ee-4ba4-8995-a8171160196c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:41.472663 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f1bae10-a6ee-4ba4-8995-a8171160196c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:41.595343 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6f1bae10-a6ee-4ba4-8995-a8171160196c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:41.603316 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6f1bae10-a6ee-4ba4-8995-a8171160196c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1452 microversion: 2.1 time: 0.143981 Oct 28 08:47:41.603907 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 459/974] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:41 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:43.553764 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-4ef7b4bd-c615-4116-855b-345e8fe3b962 req-0159168c-b818-4cea-9e48-97799518a6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e1be19-0a03-4c39-a83c-6003d4bd42d3", "tag": "fc95f307-8716-45cd-991e-6a984816ab3c"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:43.555153 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:47:43.555153 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:47:43.563461 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-4ef7b4bd-c615-4116-855b-345e8fe3b962 req-0159168c-b818-4cea-9e48-97799518a6b9 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:43.564047 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-4ef7b4bd-c615-4116-855b-345e8fe3b962 req-0159168c-b818-4cea-9e48-97799518a6b9 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:43.575001 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-4ef7b4bd-c615-4116-855b-345e8fe3b962 req-0159168c-b818-4cea-9e48-97799518a6b9 service nova] Creating event network-changed:fc95f307-8716-45cd-991e-6a984816ab3c for instance 82e1be19-0a03-4c39-a83c-6003d4bd42d3 on hv-cinder-81566 Oct 28 08:47:43.580255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-4ef7b4bd-c615-4116-855b-345e8fe3b962 req-0159168c-b818-4cea-9e48-97799518a6b9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030247 Oct 28 08:47:43.580973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 516/975] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:47:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:47:49.794650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1676862193", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2050932582", "security_groups": [{"name": "tempest-secgroup-smoke-1380748725"}], "networks": [{"uuid": "46cffedc-a76f-4c3b-a308-ea44ccc749a5"}], "block_device_mapping_v2": [{"uuid": "69962f11-d16b-407a-99c8-2332d5e87eae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:49.899234 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] validate_networks() for [('46cffedc-a76f-4c3b-a308-ea44ccc749a5', None, None, None, None, None)] {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:47:50.398235 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:47:50.398752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:47:50.399439 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:47:50.399930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:47:50.400415 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:47:50.411251 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:50.411693 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:50.412487 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:50.412921 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:50.430173 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Getting quotas for project d66afaa2b9f04ea1a518ab92aab8cb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:47:50.434077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Getting quotas for user 4327173547b5425a9e4823c883298ecf and project d66afaa2b9f04ea1a518ab92aab8cb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:47:50.493739 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:47:50.495869 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69962f11-d16b-407a-99c8-2332d5e87eae',volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:47:50.629196 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c44341aa-5945-4036-ae9b-69fddb8a8fd2 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.838184 Oct 28 08:47:50.630049 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 460/976] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:47:49 2021] POST /compute/v2.1/servers => generated 406 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:47:50.641545 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e3ee59cb-3cb4-4457-8ed4-1ab8510b7122 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:50.642295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e3ee59cb-3cb4-4457-8ed4-1ab8510b7122 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:50.713011 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e3ee59cb-3cb4-4457-8ed4-1ab8510b7122 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:50.720888 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e3ee59cb-3cb4-4457-8ed4-1ab8510b7122 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1089 microversion: 2.1 time: 0.084493 Oct 28 08:47:50.721508 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 517/977] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:50 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1089 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:51.743306 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0de6c0e0-b64d-4f36-a634-b6687fb0cac0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:51.743965 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0de6c0e0-b64d-4f36-a634-b6687fb0cac0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:51.801356 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0de6c0e0-b64d-4f36-a634-b6687fb0cac0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:51.808604 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0de6c0e0-b64d-4f36-a634-b6687fb0cac0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1089 microversion: 2.1 time: 0.070655 Oct 28 08:47:51.809169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 461/978] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:51 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:52.825475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ffc7e9c8-a2e5-45ec-a6f0-fd1252ef7673 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:52.826124 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ffc7e9c8-a2e5-45ec-a6f0-fd1252ef7673 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:52.879009 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ffc7e9c8-a2e5-45ec-a6f0-fd1252ef7673 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:52.886102 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ffc7e9c8-a2e5-45ec-a6f0-fd1252ef7673 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1089 microversion: 2.1 time: 0.063980 Oct 28 08:47:52.887169 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 518/979] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:52 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:53.903343 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5beac851-c9a2-4a0f-b108-c1764c28b29d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:53.903949 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5beac851-c9a2-4a0f-b108-c1764c28b29d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:53.911848 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5beac851-c9a2-4a0f-b108-c1764c28b29d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:53.912327 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5beac851-c9a2-4a0f-b108-c1764c28b29d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:53.913116 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5beac851-c9a2-4a0f-b108-c1764c28b29d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:53.913549 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5beac851-c9a2-4a0f-b108-c1764c28b29d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:53.981345 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5beac851-c9a2-4a0f-b108-c1764c28b29d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:53.989077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5beac851-c9a2-4a0f-b108-c1764c28b29d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1139 microversion: 2.1 time: 0.089645 Oct 28 08:47:53.989629 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 462/980] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:53 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:55.007810 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e2c7f925-11a0-4b18-9853-72eb31b60f33 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:55.008709 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e2c7f925-11a0-4b18-9853-72eb31b60f33 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:55.015485 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e2c7f925-11a0-4b18-9853-72eb31b60f33 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:55.016615 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e2c7f925-11a0-4b18-9853-72eb31b60f33 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:55.017404 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e2c7f925-11a0-4b18-9853-72eb31b60f33 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:55.018268 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e2c7f925-11a0-4b18-9853-72eb31b60f33 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:55.096348 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e2c7f925-11a0-4b18-9853-72eb31b60f33 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:55.103928 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e2c7f925-11a0-4b18-9853-72eb31b60f33 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1205 microversion: 2.1 time: 0.100713 Oct 28 08:47:55.104784 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 519/981] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:55 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1205 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:56.122928 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9a92664e-563c-46f9-b62f-94c68b005218 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:56.124200 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9a92664e-563c-46f9-b62f-94c68b005218 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:56.131398 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a92664e-563c-46f9-b62f-94c68b005218 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.132175 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a92664e-563c-46f9-b62f-94c68b005218 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.133048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a92664e-563c-46f9-b62f-94c68b005218 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.133545 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a92664e-563c-46f9-b62f-94c68b005218 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.247952 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ce09609b-8afd-43fe-97a6-082070fefadd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:56.249071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ce09609b-8afd-43fe-97a6-082070fefadd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:56.258204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ce09609b-8afd-43fe-97a6-082070fefadd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.258643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ce09609b-8afd-43fe-97a6-082070fefadd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.259432 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ce09609b-8afd-43fe-97a6-082070fefadd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.259856 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ce09609b-8afd-43fe-97a6-082070fefadd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.292594 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ce09609b-8afd-43fe-97a6-082070fefadd tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-volume_attachments/57e1f258-d991-4b61-b030-4914b4cfaada" status: 200 len: 194 microversion: 2.20 time: 0.048813 Oct 28 08:47:56.293368 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 520/982] 10.222.0.74 () {60 vars in 1453 bytes} [Thu Oct 28 08:47:56 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-volume_attachments/57e1f258-d991-4b61-b030-4914b4cfaada => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:47:56.299174 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-6ac40fd0-252f-4239-ba74-ea85f6b1b5e9 req-5fefdd51-56a1-4bac-b364-20430ff414f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1", "tag": "0151d785-b8a4-4437-9aa9-d788de11dd43"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:56.301022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:47:56.301022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:47:56.310964 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-6ac40fd0-252f-4239-ba74-ea85f6b1b5e9 req-5fefdd51-56a1-4bac-b364-20430ff414f5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.311540 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-6ac40fd0-252f-4239-ba74-ea85f6b1b5e9 req-5fefdd51-56a1-4bac-b364-20430ff414f5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.330946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-6ac40fd0-252f-4239-ba74-ea85f6b1b5e9 req-5fefdd51-56a1-4bac-b364-20430ff414f5 service nova] Creating event network-changed:0151d785-b8a4-4437-9aa9-d788de11dd43 for instance d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 on hv-cinder-81566 Oct 28 08:47:56.336667 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-6ac40fd0-252f-4239-ba74-ea85f6b1b5e9 req-5fefdd51-56a1-4bac-b364-20430ff414f5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041685 Oct 28 08:47:56.337815 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 521/983] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:47:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:47:56.380812 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9a92664e-563c-46f9-b62f-94c68b005218 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:56.391879 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9a92664e-563c-46f9-b62f-94c68b005218 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.273397 Oct 28 08:47:56.395411 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f0c1c750-0bac-4cf4-81c0-af0f7c5637d8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:56.396022 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 463/984] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:56 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:56.396683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f0c1c750-0bac-4cf4-81c0-af0f7c5637d8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:56.407162 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f0c1c750-0bac-4cf4-81c0-af0f7c5637d8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.408254 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f0c1c750-0bac-4cf4-81c0-af0f7c5637d8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.409270 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f0c1c750-0bac-4cf4-81c0-af0f7c5637d8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.409705 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f0c1c750-0bac-4cf4-81c0-af0f7c5637d8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.506677 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-f0c1c750-0bac-4cf4-81c0-af0f7c5637d8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lazy-loading 'services' on Instance uuid 423157c3-a1e9-43c5-8fda-01d1d93bd484 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:47:56.582475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f0c1c750-0bac-4cf4-81c0-af0f7c5637d8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-volume_attachments/57e1f258-d991-4b61-b030-4914b4cfaada" status: 202 len: 0 microversion: 2.20 time: 0.196515 Oct 28 08:47:56.586639 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 522/985] 10.222.0.74 () {60 vars in 1456 bytes} [Thu Oct 28 08:47:56 2021] DELETE /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-volume_attachments/57e1f258-d991-4b61-b030-4914b4cfaada => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:47:56.592560 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fb930192-250d-4508-94e4-b341fcba2307 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:56.593541 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fb930192-250d-4508-94e4-b341fcba2307 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:56.600917 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb930192-250d-4508-94e4-b341fcba2307 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.601421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb930192-250d-4508-94e4-b341fcba2307 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.602521 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb930192-250d-4508-94e4-b341fcba2307 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.603677 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb930192-250d-4508-94e4-b341fcba2307 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.638820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fb930192-250d-4508-94e4-b341fcba2307 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050200 Oct 28 08:47:56.643650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 464/986] 10.222.0.74 () {60 vars in 1342 bytes} [Thu Oct 28 08:47:56 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:47:57.415731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bde97981-c3a0-45fe-abac-5de5f864987a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:57.416517 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bde97981-c3a0-45fe-abac-5de5f864987a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:57.423828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bde97981-c3a0-45fe-abac-5de5f864987a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:57.424271 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bde97981-c3a0-45fe-abac-5de5f864987a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:57.425097 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bde97981-c3a0-45fe-abac-5de5f864987a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:57.425520 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bde97981-c3a0-45fe-abac-5de5f864987a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:57.561965 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-bde97981-c3a0-45fe-abac-5de5f864987a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:57.570067 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bde97981-c3a0-45fe-abac-5de5f864987a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.158984 Oct 28 08:47:57.570617 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 523/987] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:57 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:57.650862 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9b8d0c72-9970-4129-a074-72f4c82f4ed7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:57.651647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9b8d0c72-9970-4129-a074-72f4c82f4ed7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:57.659069 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9b8d0c72-9970-4129-a074-72f4c82f4ed7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:57.659505 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9b8d0c72-9970-4129-a074-72f4c82f4ed7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:57.660292 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9b8d0c72-9970-4129-a074-72f4c82f4ed7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:57.660718 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9b8d0c72-9970-4129-a074-72f4c82f4ed7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:57.692803 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9b8d0c72-9970-4129-a074-72f4c82f4ed7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045768 Oct 28 08:47:57.693448 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 465/988] 10.222.0.74 () {60 vars in 1342 bytes} [Thu Oct 28 08:47:57 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:47:57.750920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0df3cda9-06bf-4388-99de-97d9d607dff2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:57.751486 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0df3cda9-06bf-4388-99de-97d9d607dff2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:57.757471 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0df3cda9-06bf-4388-99de-97d9d607dff2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:57.757991 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0df3cda9-06bf-4388-99de-97d9d607dff2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:57.758776 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0df3cda9-06bf-4388-99de-97d9d607dff2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:57.759203 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0df3cda9-06bf-4388-99de-97d9d607dff2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:57.784608 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0df3cda9-06bf-4388-99de-97d9d607dff2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Going to try to terminate instance {{(pid=132797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:47:57.858889 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0df3cda9-06bf-4388-99de-97d9d607dff2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 204 len: 0 microversion: 2.20 time: 0.111346 Oct 28 08:47:57.860099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 524/989] 10.222.0.74 () {60 vars in 1279 bytes} [Thu Oct 28 08:47:57 2021] DELETE /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:47:57.869092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-36ef9648-0e4a-4ee4-99c3-313fa3da0787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:57.869696 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-36ef9648-0e4a-4ee4-99c3-313fa3da0787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:57.875793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36ef9648-0e4a-4ee4-99c3-313fa3da0787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:57.876300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36ef9648-0e4a-4ee4-99c3-313fa3da0787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:57.877064 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36ef9648-0e4a-4ee4-99c3-313fa3da0787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:57.877490 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-36ef9648-0e4a-4ee4-99c3-313fa3da0787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:58.004085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-36ef9648-0e4a-4ee4-99c3-313fa3da0787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:58.011670 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-36ef9648-0e4a-4ee4-99c3-313fa3da0787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:58.013146 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-36ef9648-0e4a-4ee4-99c3-313fa3da0787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:58.014347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-36ef9648-0e4a-4ee4-99c3-313fa3da0787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.149282 Oct 28 08:47:58.014902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 466/990] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:57 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:58.587527 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6fa85f40-e1ed-4b9d-b89a-e7aae2aea87e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:58.588223 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6fa85f40-e1ed-4b9d-b89a-e7aae2aea87e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:58.595685 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fa85f40-e1ed-4b9d-b89a-e7aae2aea87e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:58.596131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fa85f40-e1ed-4b9d-b89a-e7aae2aea87e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:58.596938 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fa85f40-e1ed-4b9d-b89a-e7aae2aea87e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:58.597369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6fa85f40-e1ed-4b9d-b89a-e7aae2aea87e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:58.726326 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6fa85f40-e1ed-4b9d-b89a-e7aae2aea87e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:58.735432 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6fa85f40-e1ed-4b9d-b89a-e7aae2aea87e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.151179 Oct 28 08:47:58.736010 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 525/991] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:58 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:59.034657 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-740cc7d5-83e9-4f92-8171-79162fbdf113 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:59.035256 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-740cc7d5-83e9-4f92-8171-79162fbdf113 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:59.041471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-740cc7d5-83e9-4f92-8171-79162fbdf113 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:59.041946 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-740cc7d5-83e9-4f92-8171-79162fbdf113 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:59.042730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-740cc7d5-83e9-4f92-8171-79162fbdf113 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:59.043154 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-740cc7d5-83e9-4f92-8171-79162fbdf113 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:59.166782 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-740cc7d5-83e9-4f92-8171-79162fbdf113 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:59.182825 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-740cc7d5-83e9-4f92-8171-79162fbdf113 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:59.184336 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-740cc7d5-83e9-4f92-8171-79162fbdf113 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:59.185495 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-740cc7d5-83e9-4f92-8171-79162fbdf113 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.156034 Oct 28 08:47:59.186229 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 467/992] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:59 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:59.754096 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-97097af2-8439-46db-8122-2349be346ea8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:59.754762 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-97097af2-8439-46db-8122-2349be346ea8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:59.761466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97097af2-8439-46db-8122-2349be346ea8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:59.761995 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97097af2-8439-46db-8122-2349be346ea8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:59.762810 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97097af2-8439-46db-8122-2349be346ea8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:59.763250 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97097af2-8439-46db-8122-2349be346ea8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:59.920173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-97097af2-8439-46db-8122-2349be346ea8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:59.928339 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-97097af2-8439-46db-8122-2349be346ea8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.179633 Oct 28 08:47:59.928910 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 526/993] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:59 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:00.203945 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1f3c9abd-84ff-4078-9929-128375d2e4a9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:00.204491 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1f3c9abd-84ff-4078-9929-128375d2e4a9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:00.210669 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f3c9abd-84ff-4078-9929-128375d2e4a9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:00.211106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f3c9abd-84ff-4078-9929-128375d2e4a9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:00.211866 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f3c9abd-84ff-4078-9929-128375d2e4a9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:00.212288 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f3c9abd-84ff-4078-9929-128375d2e4a9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:00.690966 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1f3c9abd-84ff-4078-9929-128375d2e4a9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:00.699181 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1f3c9abd-84ff-4078-9929-128375d2e4a9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:00.700578 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1f3c9abd-84ff-4078-9929-128375d2e4a9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:00.701922 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1f3c9abd-84ff-4078-9929-128375d2e4a9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1721 microversion: 2.20 time: 0.502347 Oct 28 08:48:00.705823 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 468/994] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:00 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1721 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:48:00.944447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6201c60d-fa9e-4c61-a82d-e73c893c3b04 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:00.945079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6201c60d-fa9e-4c61-a82d-e73c893c3b04 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:00.951874 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6201c60d-fa9e-4c61-a82d-e73c893c3b04 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:00.952311 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6201c60d-fa9e-4c61-a82d-e73c893c3b04 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:00.953130 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6201c60d-fa9e-4c61-a82d-e73c893c3b04 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:00.954150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6201c60d-fa9e-4c61-a82d-e73c893c3b04 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.049455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-667272b5-b4c1-4da1-b419-6044e174f079 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:01.050644 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-667272b5-b4c1-4da1-b419-6044e174f079 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:01.057058 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-667272b5-b4c1-4da1-b419-6044e174f079 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.057494 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-667272b5-b4c1-4da1-b419-6044e174f079 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.058304 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-667272b5-b4c1-4da1-b419-6044e174f079 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.058858 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-667272b5-b4c1-4da1-b419-6044e174f079 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.112610 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-667272b5-b4c1-4da1-b419-6044e174f079 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067855 Oct 28 08:48:01.113241 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 469/995] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:48:01 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:01.174161 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-4a814e3d-53b1-4d2e-a91d-af5cfa2a44d6 req-9b8165cf-bf7a-4abd-9f1b-bf8fa3f29685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423157c3-a1e9-43c5-8fda-01d1d93bd484", "name": "network-vif-deleted", "tag": "2e8c6f82-a258-4342-aacf-0b4e80ccd12e"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:01.174607 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6201c60d-fa9e-4c61-a82d-e73c893c3b04 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:01.189136 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:01.189136 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:48:01.204255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6201c60d-fa9e-4c61-a82d-e73c893c3b04 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.263361 Oct 28 08:48:01.205284 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 527/996] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:00 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:01.210799 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6428160c-8845-42e3-823c-5c4bc3960a62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:01.211569 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6428160c-8845-42e3-823c-5c4bc3960a62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:01.214454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-4a814e3d-53b1-4d2e-a91d-af5cfa2a44d6 req-9b8165cf-bf7a-4abd-9f1b-bf8fa3f29685 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.216192 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-4a814e3d-53b1-4d2e-a91d-af5cfa2a44d6 req-9b8165cf-bf7a-4abd-9f1b-bf8fa3f29685 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.217929 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6428160c-8845-42e3-823c-5c4bc3960a62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.218386 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6428160c-8845-42e3-823c-5c4bc3960a62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.219386 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6428160c-8845-42e3-823c-5c4bc3960a62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.219827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6428160c-8845-42e3-823c-5c4bc3960a62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.253000 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-4a814e3d-53b1-4d2e-a91d-af5cfa2a44d6 req-9b8165cf-bf7a-4abd-9f1b-bf8fa3f29685 service nova] Creating event network-vif-deleted:2e8c6f82-a258-4342-aacf-0b4e80ccd12e for instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 on hv-cinder-81566 Oct 28 08:48:01.258537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6428160c-8845-42e3-823c-5c4bc3960a62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Going to try to terminate instance {{(pid=132797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:48:01.268522 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-4a814e3d-53b1-4d2e-a91d-af5cfa2a44d6 req-9b8165cf-bf7a-4abd-9f1b-bf8fa3f29685 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102922 Oct 28 08:48:01.275445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 470/997] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:01.368588 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6428160c-8845-42e3-823c-5c4bc3960a62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 204 len: 0 microversion: 2.1 time: 0.161716 Oct 28 08:48:01.369478 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 528/998] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:48:01 2021] DELETE /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:48:01.378347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-324b58e1-d3c7-45fe-a8bb-eee2cbe7247d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:01.379293 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-324b58e1-d3c7-45fe-a8bb-eee2cbe7247d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:01.386639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-324b58e1-d3c7-45fe-a8bb-eee2cbe7247d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.387083 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-324b58e1-d3c7-45fe-a8bb-eee2cbe7247d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.387864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-324b58e1-d3c7-45fe-a8bb-eee2cbe7247d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.388295 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-324b58e1-d3c7-45fe-a8bb-eee2cbe7247d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.521372 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-324b58e1-d3c7-45fe-a8bb-eee2cbe7247d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:01.529289 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-324b58e1-d3c7-45fe-a8bb-eee2cbe7247d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1673 microversion: 2.1 time: 0.155502 Oct 28 08:48:01.529903 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 471/999] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:01 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:01.723314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:01.724311 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:01.731285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.732089 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.732959 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.733623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.770264 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.770878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.772035 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lazy-loading 'fault' on Instance uuid 423157c3-a1e9-43c5-8fda-01d1d93bd484 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:48:01.820556 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:01.827664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:01.829857 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:01.831099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f3c7404b-64ad-402d-ba88-8a41e5cd7adb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 200 len: 1370 microversion: 2.20 time: 0.113514 Oct 28 08:48:01.831674 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 529/1000] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:01 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 1370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:48:02.235214 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-050bc0bf-e12f-4d2c-963d-c3bfd98c893b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:02.235740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-050bc0bf-e12f-4d2c-963d-c3bfd98c893b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:02.242152 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-050bc0bf-e12f-4d2c-963d-c3bfd98c893b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:02.242705 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-050bc0bf-e12f-4d2c-963d-c3bfd98c893b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:02.243616 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-050bc0bf-e12f-4d2c-963d-c3bfd98c893b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:02.243975 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-050bc0bf-e12f-4d2c-963d-c3bfd98c893b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:02.379179 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-050bc0bf-e12f-4d2c-963d-c3bfd98c893b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:02.386916 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-050bc0bf-e12f-4d2c-963d-c3bfd98c893b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.156174 Oct 28 08:48:02.387484 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 472/1001] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:02 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:02.548452 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8b143ad8-65d9-4f68-b8cc-340beb12a304 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:02.549063 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8b143ad8-65d9-4f68-b8cc-340beb12a304 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:02.555332 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8b143ad8-65d9-4f68-b8cc-340beb12a304 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:02.555775 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8b143ad8-65d9-4f68-b8cc-340beb12a304 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:02.556545 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8b143ad8-65d9-4f68-b8cc-340beb12a304 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:02.557286 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8b143ad8-65d9-4f68-b8cc-340beb12a304 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:02.686888 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8b143ad8-65d9-4f68-b8cc-340beb12a304 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:02.696076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8b143ad8-65d9-4f68-b8cc-340beb12a304 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1673 microversion: 2.1 time: 0.151980 Oct 28 08:48:02.696643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 530/1002] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:02 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:02.849945 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a0f1dd3f-9a86-417c-ae25-9421f91bf871 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:02.850458 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a0f1dd3f-9a86-417c-ae25-9421f91bf871 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:02.856837 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a0f1dd3f-9a86-417c-ae25-9421f91bf871 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:02.857588 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a0f1dd3f-9a86-417c-ae25-9421f91bf871 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:02.858607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a0f1dd3f-9a86-417c-ae25-9421f91bf871 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:02.859035 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a0f1dd3f-9a86-417c-ae25-9421f91bf871 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:02.873865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-a0f1dd3f-9a86-417c-ae25-9421f91bf871 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] HTTP exception thrown: Instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 could not be found. Oct 28 08:48:02.874464 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a0f1dd3f-9a86-417c-ae25-9421f91bf871 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Returning 404 to user: Instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:48:02.875963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a0f1dd3f-9a86-417c-ae25-9421f91bf871 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 404 len: 111 microversion: 2.20 time: 0.029755 Oct 28 08:48:02.876825 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 473/1003] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:02 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:48:02.884951 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bf75f8c1-d4c4-49a7-a003-5c06210ad4bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '.version_select at 0x7f9e6bedb820>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:02.909170 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bf75f8c1-d4c4-49a7-a003-5c06210ad4bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-725916061" status: 204 len: 0 microversion: 2.20 time: 0.027801 Oct 28 08:48:02.909757 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 531/1004] 10.222.0.74 () {60 vars in 1258 bytes} [Thu Oct 28 08:48:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-725916061 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:48:03.407048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-51ec8c52-2d72-4d89-b2f6-fe642ac0e163 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:03.408527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-51ec8c52-2d72-4d89-b2f6-fe642ac0e163 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:03.415472 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-51ec8c52-2d72-4d89-b2f6-fe642ac0e163 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:03.416142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-51ec8c52-2d72-4d89-b2f6-fe642ac0e163 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:03.417112 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-51ec8c52-2d72-4d89-b2f6-fe642ac0e163 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:03.417692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-51ec8c52-2d72-4d89-b2f6-fe642ac0e163 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:03.692397 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-51ec8c52-2d72-4d89-b2f6-fe642ac0e163 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:03.700266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-51ec8c52-2d72-4d89-b2f6-fe642ac0e163 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.298367 Oct 28 08:48:03.710016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 474/1005] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:03 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:03.718459 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dcfcf2a6-bee7-4f22-a25b-5df4dcc00553 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:03.720483 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dcfcf2a6-bee7-4f22-a25b-5df4dcc00553 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:03.727529 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dcfcf2a6-bee7-4f22-a25b-5df4dcc00553 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:03.728120 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dcfcf2a6-bee7-4f22-a25b-5df4dcc00553 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:03.729076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dcfcf2a6-bee7-4f22-a25b-5df4dcc00553 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:03.729679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dcfcf2a6-bee7-4f22-a25b-5df4dcc00553 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:03.817455 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dcfcf2a6-bee7-4f22-a25b-5df4dcc00553 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:03.827266 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dcfcf2a6-bee7-4f22-a25b-5df4dcc00553 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 200 len: 1605 microversion: 2.1 time: 0.110948 Oct 28 08:48:03.836772 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 532/1006] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:03 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 1605 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:03.934718 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0ec3ff4e-2c27-4571-ad0e-f67d208c54d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'create', calling method: .version_select at 0x7f9e780980d0>, body: {"keypair": {"name": "tempest-keypair-133372109"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:03.947790 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-b5ceb902-6541-44d3-a489-1fe190909e1e req-d04aa6ab-3f92-4dd3-bf56-06409dfc6d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d46e50-0675-4d39-9947-f35acce9f945", "name": "network-vif-deleted", "tag": "ca1bece9-ad29-4024-93d9-2e154ebe1e8e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:03.950949 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:03.950949 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:48:03.956230 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-0ec3ff4e-2c27-4571-ad0e-f67d208c54d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:48:03.960913 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-0ec3ff4e-2c27-4571-ad0e-f67d208c54d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for user c8ccd80f4552487583ff9076adab3b25 and project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:48:03.966768 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-b5ceb902-6541-44d3-a489-1fe190909e1e req-d04aa6ab-3f92-4dd3-bf56-06409dfc6d4b service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:03.967214 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-b5ceb902-6541-44d3-a489-1fe190909e1e req-d04aa6ab-3f92-4dd3-bf56-06409dfc6d4b service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:03.980642 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-b5ceb902-6541-44d3-a489-1fe190909e1e req-d04aa6ab-3f92-4dd3-bf56-06409dfc6d4b service nova] Creating event network-vif-deleted:ca1bece9-ad29-4024-93d9-2e154ebe1e8e for instance a8d46e50-0675-4d39-9947-f35acce9f945 on hv-cinder-81566 Oct 28 08:48:03.987021 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-b5ceb902-6541-44d3-a489-1fe190909e1e req-d04aa6ab-3f92-4dd3-bf56-06409dfc6d4b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050353 Oct 28 08:48:03.988243 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 533/1007] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:48:04.142438 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-0ec3ff4e-2c27-4571-ad0e-f67d208c54d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:48:04.146095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-0ec3ff4e-2c27-4571-ad0e-f67d208c54d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for user c8ccd80f4552487583ff9076adab3b25 and project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:48:04.161213 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0ec3ff4e-2c27-4571-ad0e-f67d208c54d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.230254 Oct 28 08:48:04.162012 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 475/1008] 10.222.0.74 () {62 vars in 1198 bytes} [Thu Oct 28 08:48:03 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:48:04.718404 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7211860b-b066-4fbd-9697-ebce2152fb06 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:04.720163 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7211860b-b066-4fbd-9697-ebce2152fb06 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:04.729548 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7211860b-b066-4fbd-9697-ebce2152fb06 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:04.730365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7211860b-b066-4fbd-9697-ebce2152fb06 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:04.731531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7211860b-b066-4fbd-9697-ebce2152fb06 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:04.732619 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7211860b-b066-4fbd-9697-ebce2152fb06 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:04.847415 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-251c865b-8ad5-46e9-a996-28ef9c6967fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:04.848195 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-251c865b-8ad5-46e9-a996-28ef9c6967fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:04.859106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-251c865b-8ad5-46e9-a996-28ef9c6967fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:04.861312 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-251c865b-8ad5-46e9-a996-28ef9c6967fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:04.863193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-251c865b-8ad5-46e9-a996-28ef9c6967fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:04.864088 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-251c865b-8ad5-46e9-a996-28ef9c6967fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:04.884266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-251c865b-8ad5-46e9-a996-28ef9c6967fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] HTTP exception thrown: Instance a8d46e50-0675-4d39-9947-f35acce9f945 could not be found. Oct 28 08:48:04.885355 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-251c865b-8ad5-46e9-a996-28ef9c6967fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Returning 404 to user: Instance a8d46e50-0675-4d39-9947-f35acce9f945 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:48:04.886356 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-251c865b-8ad5-46e9-a996-28ef9c6967fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 404 len: 111 microversion: 2.1 time: 0.045789 Oct 28 08:48:04.886502 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-7211860b-b066-4fbd-9697-ebce2152fb06 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:04.891893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 476/1009] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:04 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:48:04.895610 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7211860b-b066-4fbd-9697-ebce2152fb06 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.181418 Oct 28 08:48:04.896322 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 534/1010] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:04 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:04.906979 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-068fadf0-19fe-48d6-9286-1b8321d78394 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '.version_select at 0x7f9e7801c280>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:04.925768 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-068fadf0-19fe-48d6-9286-1b8321d78394 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061175081" status: 202 len: 0 microversion: 2.1 time: 0.026836 Oct 28 08:48:04.927040 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 477/1011] 10.222.0.74 () {58 vars in 1220 bytes} [Thu Oct 28 08:48:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061175081 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:05.711406 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1577291187", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1bb7b256-4baa-432c-addc-978134812fe5"}], "security_groups": [{"name": "tempest-securitygroup--371938791"}], "key_name": "tempest-keypair-133372109", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:05.748521 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9c051254-ad6f-4d8f-8d74-e13101435559 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'create', calling method: .version_select at 0x7f9e780989d0>, body: {"keypair": {"name": "tempest-keypair-1457393952"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:05.767567 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-9c051254-ad6f-4d8f-8d74-e13101435559 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for project deb9a75c575b487eb97a2f189099cb83. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:48:05.772517 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-9c051254-ad6f-4d8f-8d74-e13101435559 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for user 779e2e826df7468d9a84e8f401693d3f and project deb9a75c575b487eb97a2f189099cb83. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:48:05.823722 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.network.neutron [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] validate_networks() for [('1bb7b256-4baa-432c-addc-978134812fe5', None, None, None, None, None)] {{(pid=132797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:48:05.997419 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-9c051254-ad6f-4d8f-8d74-e13101435559 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for project deb9a75c575b487eb97a2f189099cb83. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:48:06.001675 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-9c051254-ad6f-4d8f-8d74-e13101435559 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for user 779e2e826df7468d9a84e8f401693d3f and project deb9a75c575b487eb97a2f189099cb83. Resources: {'key_pairs'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:48:06.024150 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9c051254-ad6f-4d8f-8d74-e13101435559 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.279337 Oct 28 08:48:06.024752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 478/1012] 10.222.0.74 () {60 vars in 1157 bytes} [Thu Oct 28 08:48:05 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:06.030172 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f8489a52-d6e9-4792-a928-a5c63881cd1f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:06.030726 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f8489a52-d6e9-4792-a928-a5c63881cd1f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:06.037358 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f8489a52-d6e9-4792-a928-a5c63881cd1f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:06.037832 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f8489a52-d6e9-4792-a928-a5c63881cd1f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:06.038617 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f8489a52-d6e9-4792-a928-a5c63881cd1f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:06.039060 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f8489a52-d6e9-4792-a928-a5c63881cd1f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:06.264562 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f8489a52-d6e9-4792-a928-a5c63881cd1f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:06.280048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f8489a52-d6e9-4792-a928-a5c63881cd1f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.253536 Oct 28 08:48:06.280840 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 479/1013] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:06 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:06.293768 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Flavor limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:48:06.294299 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Image limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:48:06.294765 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Flavor pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:48:06.295166 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Image pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:48:06.295575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:48:06.306996 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:06.307520 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:06.308610 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:06.309125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:06.330115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:48:06.336537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Getting quotas for user c8ccd80f4552487583ff9076adab3b25 and project 7e7a189da1ab4c96a271af47ac4baa62. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:48:06.350544 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Going to run 1 instances... {{(pid=132797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:48:06.353128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:48:06.404080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d9b523dc-5c6d-47a8-a225-18ef62254771 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.697033 Oct 28 08:48:06.404731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 535/1014] 10.222.0.74 () {62 vars in 1187 bytes} [Thu Oct 28 08:48:05 2021] POST /compute/v2.1/servers => generated 401 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 08:48:06.422947 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e9224d50-709e-4df3-90e3-d16f1bb59909 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:06.423558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e9224d50-709e-4df3-90e3-d16f1bb59909 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:06.499691 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e9224d50-709e-4df3-90e3-d16f1bb59909 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:06.508376 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e9224d50-709e-4df3-90e3-d16f1bb59909 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:06.509903 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e9224d50-709e-4df3-90e3-d16f1bb59909 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:06.511019 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e9224d50-709e-4df3-90e3-d16f1bb59909 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1281 microversion: 2.20 time: 0.092405 Oct 28 08:48:06.511759 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 480/1015] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:06 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:48:07.298867 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-68f73405-938f-4744-a0f3-9540c292a869 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:07.299490 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-68f73405-938f-4744-a0f3-9540c292a869 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:07.308643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68f73405-938f-4744-a0f3-9540c292a869 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:07.309083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68f73405-938f-4744-a0f3-9540c292a869 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:07.309895 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68f73405-938f-4744-a0f3-9540c292a869 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:07.310455 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68f73405-938f-4744-a0f3-9540c292a869 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:07.531039 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c5bff7a8-93f7-465b-ac98-1c3738b2a8ff tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:07.536142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c5bff7a8-93f7-465b-ac98-1c3738b2a8ff tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:07.556560 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-68f73405-938f-4744-a0f3-9540c292a869 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:07.563169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c5bff7a8-93f7-465b-ac98-1c3738b2a8ff tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:07.563765 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c5bff7a8-93f7-465b-ac98-1c3738b2a8ff tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:07.564698 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c5bff7a8-93f7-465b-ac98-1c3738b2a8ff tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:07.566253 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c5bff7a8-93f7-465b-ac98-1c3738b2a8ff tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:07.572830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-68f73405-938f-4744-a0f3-9540c292a869 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.278925 Oct 28 08:48:07.576567 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 536/1016] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:07 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:07.624154 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1989764224", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8054d646-b889-4c53-8d8e-0b66f004b73f"}], "security_groups": [{"name": "tempest-securitygroup--1789843315"}], "key_name": "tempest-keypair-1457393952", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:07.667218 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c5bff7a8-93f7-465b-ac98-1c3738b2a8ff tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:07.678540 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c5bff7a8-93f7-465b-ac98-1c3738b2a8ff tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:07.680967 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c5bff7a8-93f7-465b-ac98-1c3738b2a8ff tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:07.682337 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c5bff7a8-93f7-465b-ac98-1c3738b2a8ff tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1341 microversion: 2.20 time: 0.156440 Oct 28 08:48:07.698512 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 481/1017] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:07 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:48:07.783163 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.network.neutron [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] validate_networks() for [('8054d646-b889-4c53-8d8e-0b66f004b73f', None, None, None, None, None)] {{(pid=132797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:48:08.592512 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bdab56a1-bb40-461e-a71e-39dadf07f8bb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:08.593112 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bdab56a1-bb40-461e-a71e-39dadf07f8bb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:08.600251 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bdab56a1-bb40-461e-a71e-39dadf07f8bb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:08.600687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bdab56a1-bb40-461e-a71e-39dadf07f8bb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:08.601454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bdab56a1-bb40-461e-a71e-39dadf07f8bb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:08.601909 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bdab56a1-bb40-461e-a71e-39dadf07f8bb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:08.788489 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Flavor limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:48:08.789683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Image limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:48:08.790309 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Flavor pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:48:08.790818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Image pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:48:08.791374 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:48:08.811010 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:08.812016 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:08.816208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:08.817121 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:08.845207 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for project deb9a75c575b487eb97a2f189099cb83. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:48:08.849315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Getting quotas for user 779e2e826df7468d9a84e8f401693d3f and project deb9a75c575b487eb97a2f189099cb83. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:48:08.861570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Going to run 1 instances... {{(pid=132797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:48:08.863951 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:48:08.919682 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a3b0aa96-77aa-4788-844e-7149a272acf7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.299610 Oct 28 08:48:08.921770 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 537/1018] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:48:07 2021] POST /compute/v2.1/servers => generated 402 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 08:48:08.927481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-331cc631-c03c-41b9-8d82-b251b7674a3b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:08.928228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-331cc631-c03c-41b9-8d82-b251b7674a3b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:08.934451 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-331cc631-c03c-41b9-8d82-b251b7674a3b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:08.934891 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-331cc631-c03c-41b9-8d82-b251b7674a3b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:08.935941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-331cc631-c03c-41b9-8d82-b251b7674a3b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:08.936109 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-331cc631-c03c-41b9-8d82-b251b7674a3b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:08.975801 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-bdab56a1-bb40-461e-a71e-39dadf07f8bb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:08.984242 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bdab56a1-bb40-461e-a71e-39dadf07f8bb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.394827 Oct 28 08:48:08.985999 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 482/1019] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:08 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:08.991213 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-02369379-a6aa-4346-9e39-d8d55667ad1c req-eda844fc-16fa-4386-994f-469ee49390b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1", "name": "network-vif-plugged", "status": "completed", "tag": "0151d785-b8a4-4437-9aa9-d788de11dd43"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:08.993643 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:08.993643 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:48:09.007706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-02369379-a6aa-4346-9e39-d8d55667ad1c req-eda844fc-16fa-4386-994f-469ee49390b3 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:09.009012 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-02369379-a6aa-4346-9e39-d8d55667ad1c req-eda844fc-16fa-4386-994f-469ee49390b3 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:09.026204 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-02369379-a6aa-4346-9e39-d8d55667ad1c req-eda844fc-16fa-4386-994f-469ee49390b3 service nova] Creating event network-vif-plugged:0151d785-b8a4-4437-9aa9-d788de11dd43 for instance d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 on hv-cinder-81566 Oct 28 08:48:09.034425 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-02369379-a6aa-4346-9e39-d8d55667ad1c req-eda844fc-16fa-4386-994f-469ee49390b3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046721 Oct 28 08:48:09.035391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 483/1020] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:09.043492 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0e421708-0350-42d0-b9bc-5d4447f077b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:09.044178 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0e421708-0350-42d0-b9bc-5d4447f077b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:09.151550 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0e421708-0350-42d0-b9bc-5d4447f077b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:09.174110 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0e421708-0350-42d0-b9bc-5d4447f077b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1238 microversion: 2.1 time: 0.137234 Oct 28 08:48:09.175083 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 484/1021] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:09 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1238 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:09.235241 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-331cc631-c03c-41b9-8d82-b251b7674a3b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:09.255410 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-331cc631-c03c-41b9-8d82-b251b7674a3b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:09.266639 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-331cc631-c03c-41b9-8d82-b251b7674a3b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:09.267875 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-331cc631-c03c-41b9-8d82-b251b7674a3b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1406 microversion: 2.20 time: 0.346531 Oct 28 08:48:09.270126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 538/1022] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:08 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:48:09.905375 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-a6df7c78-b937-46fb-aa69-7f563805030e req-36886ddc-238e-42f8-9979-806732d480b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44471d5a-b894-4e3f-b59d-b03afd03839b", "tag": "21594cc8-c73a-42e8-9350-519f7620496e"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:09.907075 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:09.907075 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:48:09.917607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-a6df7c78-b937-46fb-aa69-7f563805030e req-36886ddc-238e-42f8-9979-806732d480b5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:09.918216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-a6df7c78-b937-46fb-aa69-7f563805030e req-36886ddc-238e-42f8-9979-806732d480b5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:09.935637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-a6df7c78-b937-46fb-aa69-7f563805030e req-36886ddc-238e-42f8-9979-806732d480b5 service nova] Creating event network-changed:21594cc8-c73a-42e8-9350-519f7620496e for instance 44471d5a-b894-4e3f-b59d-b03afd03839b on hv-cinder-81566 Oct 28 08:48:09.947579 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-a6df7c78-b937-46fb-aa69-7f563805030e req-36886ddc-238e-42f8-9979-806732d480b5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045597 Oct 28 08:48:09.948932 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 485/1023] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:10.001234 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-05c99757-bd49-4bc6-8f90-490633ef6b42 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:10.002381 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-05c99757-bd49-4bc6-8f90-490633ef6b42 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:10.009522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-05c99757-bd49-4bc6-8f90-490633ef6b42 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:10.010241 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-05c99757-bd49-4bc6-8f90-490633ef6b42 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:10.011230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-05c99757-bd49-4bc6-8f90-490633ef6b42 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:10.011672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-05c99757-bd49-4bc6-8f90-490633ef6b42 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:10.193032 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-942d7c1b-ada1-429f-95b8-402bceaab7ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:10.193777 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-942d7c1b-ada1-429f-95b8-402bceaab7ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:10.200502 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-942d7c1b-ada1-429f-95b8-402bceaab7ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:10.200973 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-942d7c1b-ada1-429f-95b8-402bceaab7ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:10.201801 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-942d7c1b-ada1-429f-95b8-402bceaab7ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:10.202256 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-942d7c1b-ada1-429f-95b8-402bceaab7ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:10.233839 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-05c99757-bd49-4bc6-8f90-490633ef6b42 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:10.241657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-05c99757-bd49-4bc6-8f90-490633ef6b42 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1261 microversion: 2.1 time: 0.244986 Oct 28 08:48:10.242678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 539/1024] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:09 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1261 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:10.276701 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-942d7c1b-ada1-429f-95b8-402bceaab7ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:10.287080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-973265b9-af35-4202-bc0b-cccbd42c8d46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:10.287327 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-942d7c1b-ada1-429f-95b8-402bceaab7ff tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1290 microversion: 2.1 time: 0.099247 Oct 28 08:48:10.288168 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-973265b9-af35-4202-bc0b-cccbd42c8d46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:10.295256 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-973265b9-af35-4202-bc0b-cccbd42c8d46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:10.295954 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-973265b9-af35-4202-bc0b-cccbd42c8d46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:10.296884 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-973265b9-af35-4202-bc0b-cccbd42c8d46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:10.297820 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-973265b9-af35-4202-bc0b-cccbd42c8d46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:10.299011 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 486/1025] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:10 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:10.523099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-973265b9-af35-4202-bc0b-cccbd42c8d46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:10.533934 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-973265b9-af35-4202-bc0b-cccbd42c8d46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:10.535714 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-973265b9-af35-4202-bc0b-cccbd42c8d46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:10.537598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-973265b9-af35-4202-bc0b-cccbd42c8d46 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1406 microversion: 2.20 time: 0.254551 Oct 28 08:48:10.538584 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 540/1026] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:10 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:48:11.264120 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c0d26910-b268-421b-aa3d-9759cd06dc45 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:11.264897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c0d26910-b268-421b-aa3d-9759cd06dc45 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:11.271621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c0d26910-b268-421b-aa3d-9759cd06dc45 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.272069 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c0d26910-b268-421b-aa3d-9759cd06dc45 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.273060 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c0d26910-b268-421b-aa3d-9759cd06dc45 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.273498 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c0d26910-b268-421b-aa3d-9759cd06dc45 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.306101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-08a1a3d9-c5fb-4997-bf09-50d7ce7dec35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:11.306991 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-08a1a3d9-c5fb-4997-bf09-50d7ce7dec35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:11.315938 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08a1a3d9-c5fb-4997-bf09-50d7ce7dec35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.316475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08a1a3d9-c5fb-4997-bf09-50d7ce7dec35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.317585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08a1a3d9-c5fb-4997-bf09-50d7ce7dec35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.318675 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08a1a3d9-c5fb-4997-bf09-50d7ce7dec35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.499861 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c0d26910-b268-421b-aa3d-9759cd06dc45 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:11.507812 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-08a1a3d9-c5fb-4997-bf09-50d7ce7dec35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:11.513246 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c0d26910-b268-421b-aa3d-9759cd06dc45 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1444 microversion: 2.1 time: 0.253472 Oct 28 08:48:11.514332 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 487/1027] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:11 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1444 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:11.529706 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-08a1a3d9-c5fb-4997-bf09-50d7ce7dec35 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1364 microversion: 2.1 time: 0.227462 Oct 28 08:48:11.533839 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-20088ca0-f5b8-4e0b-ae58-3bd0d3ff1f54 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:11.534034 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 541/1028] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:11 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:11.534148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-20088ca0-f5b8-4e0b-ae58-3bd0d3ff1f54 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:11.538320 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20088ca0-f5b8-4e0b-ae58-3bd0d3ff1f54 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.538876 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20088ca0-f5b8-4e0b-ae58-3bd0d3ff1f54 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.539754 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20088ca0-f5b8-4e0b-ae58-3bd0d3ff1f54 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.540291 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20088ca0-f5b8-4e0b-ae58-3bd0d3ff1f54 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.556744 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dd91cdbf-c428-4ef2-a304-2304a7c8e820 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:11.557590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dd91cdbf-c428-4ef2-a304-2304a7c8e820 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:11.564255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd91cdbf-c428-4ef2-a304-2304a7c8e820 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.564649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd91cdbf-c428-4ef2-a304-2304a7c8e820 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.565505 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd91cdbf-c428-4ef2-a304-2304a7c8e820 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.566042 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd91cdbf-c428-4ef2-a304-2304a7c8e820 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.747859 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-20088ca0-f5b8-4e0b-ae58-3bd0d3ff1f54 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:11.760083 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-20088ca0-f5b8-4e0b-ae58-3bd0d3ff1f54 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1444 microversion: 2.1 time: 0.233316 Oct 28 08:48:11.761201 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 488/1029] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:11 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1444 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:11.774852 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dd91cdbf-c428-4ef2-a304-2304a7c8e820 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:11.788879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dd91cdbf-c428-4ef2-a304-2304a7c8e820 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:11.790489 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dd91cdbf-c428-4ef2-a304-2304a7c8e820 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:11.791909 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dd91cdbf-c428-4ef2-a304-2304a7c8e820 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1406 microversion: 2.20 time: 0.239186 Oct 28 08:48:11.792468 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 542/1030] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:11 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:48:12.101938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-2af0f094-d8b2-4600-9851-933c7394ab85 req-8990affc-302d-4a71-98a9-65008cc48dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d4d877-fc9e-4f25-a21c-219f08ecdcff", "tag": "0616e940-d1b6-4c1e-b63c-17fc1651dfba"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:12.103717 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:12.103717 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:48:12.112527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-2af0f094-d8b2-4600-9851-933c7394ab85 req-8990affc-302d-4a71-98a9-65008cc48dfa service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:12.114212 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-2af0f094-d8b2-4600-9851-933c7394ab85 req-8990affc-302d-4a71-98a9-65008cc48dfa service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:12.134417 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-2af0f094-d8b2-4600-9851-933c7394ab85 req-8990affc-302d-4a71-98a9-65008cc48dfa service nova] Creating event network-changed:0616e940-d1b6-4c1e-b63c-17fc1651dfba for instance 60d4d877-fc9e-4f25-a21c-219f08ecdcff on hv-cinder-81566 Oct 28 08:48:12.140110 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-2af0f094-d8b2-4600-9851-933c7394ab85 req-8990affc-302d-4a71-98a9-65008cc48dfa service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235916 Oct 28 08:48:12.140768 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 489/1031] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:12.548328 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4c9da4fb-2c47-4532-9e72-9e9deb22f4b6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:12.549701 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4c9da4fb-2c47-4532-9e72-9e9deb22f4b6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:12.556279 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c9da4fb-2c47-4532-9e72-9e9deb22f4b6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:12.556808 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c9da4fb-2c47-4532-9e72-9e9deb22f4b6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:12.557741 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c9da4fb-2c47-4532-9e72-9e9deb22f4b6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:12.558358 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c9da4fb-2c47-4532-9e72-9e9deb22f4b6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:12.813153 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-41f20e5c-769a-4784-9d4c-1ee0796b88a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:12.814030 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-41f20e5c-769a-4784-9d4c-1ee0796b88a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:12.819936 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-4c9da4fb-2c47-4532-9e72-9e9deb22f4b6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:12.824290 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-41f20e5c-769a-4784-9d4c-1ee0796b88a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:12.824746 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-41f20e5c-769a-4784-9d4c-1ee0796b88a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:12.825692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-41f20e5c-769a-4784-9d4c-1ee0796b88a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:12.826010 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-41f20e5c-769a-4784-9d4c-1ee0796b88a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:12.837254 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4c9da4fb-2c47-4532-9e72-9e9deb22f4b6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1364 microversion: 2.1 time: 0.293682 Oct 28 08:48:12.839667 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 543/1032] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:12 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1364 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:13.032857 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-41f20e5c-769a-4784-9d4c-1ee0796b88a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:13.041161 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-41f20e5c-769a-4784-9d4c-1ee0796b88a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:13.042738 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-41f20e5c-769a-4784-9d4c-1ee0796b88a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:13.043904 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-41f20e5c-769a-4784-9d4c-1ee0796b88a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1406 microversion: 2.20 time: 0.236104 Oct 28 08:48:13.044499 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 490/1033] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:12 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:48:13.855671 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-95d24ccf-6896-4b01-ae44-884983385ef0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:13.856271 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-95d24ccf-6896-4b01-ae44-884983385ef0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:13.863362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95d24ccf-6896-4b01-ae44-884983385ef0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:13.863836 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95d24ccf-6896-4b01-ae44-884983385ef0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:13.864867 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95d24ccf-6896-4b01-ae44-884983385ef0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:13.865305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95d24ccf-6896-4b01-ae44-884983385ef0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:14.062572 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e3c42cc9-6b07-41a1-81a8-c6df0d4501e1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:14.064595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e3c42cc9-6b07-41a1-81a8-c6df0d4501e1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:14.072208 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c42cc9-6b07-41a1-81a8-c6df0d4501e1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:14.072686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c42cc9-6b07-41a1-81a8-c6df0d4501e1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:14.073503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c42cc9-6b07-41a1-81a8-c6df0d4501e1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:14.074118 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c42cc9-6b07-41a1-81a8-c6df0d4501e1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:14.077879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-95d24ccf-6896-4b01-ae44-884983385ef0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:14.089164 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-95d24ccf-6896-4b01-ae44-884983385ef0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1364 microversion: 2.1 time: 0.237553 Oct 28 08:48:14.103074 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 544/1034] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:13 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:14.114453 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-10d1fef7-753d-432d-997a-545568a03c88 req-af8f3d02-ed1e-4bad-a14b-401622f51aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1", "tag": "0151d785-b8a4-4437-9aa9-d788de11dd43"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:14.116868 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:14.116868 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:48:14.124649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-10d1fef7-753d-432d-997a-545568a03c88 req-af8f3d02-ed1e-4bad-a14b-401622f51aee service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:14.125423 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-10d1fef7-753d-432d-997a-545568a03c88 req-af8f3d02-ed1e-4bad-a14b-401622f51aee service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:14.136937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-10d1fef7-753d-432d-997a-545568a03c88 req-af8f3d02-ed1e-4bad-a14b-401622f51aee service nova] Creating event network-changed:0151d785-b8a4-4437-9aa9-d788de11dd43 for instance d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 on hv-cinder-81566 Oct 28 08:48:14.143568 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-10d1fef7-753d-432d-997a-545568a03c88 req-af8f3d02-ed1e-4bad-a14b-401622f51aee service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033937 Oct 28 08:48:14.144616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 545/1035] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:14.229849 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e3c42cc9-6b07-41a1-81a8-c6df0d4501e1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:14.238084 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e3c42cc9-6b07-41a1-81a8-c6df0d4501e1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:14.239601 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e3c42cc9-6b07-41a1-81a8-c6df0d4501e1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:14.241156 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e3c42cc9-6b07-41a1-81a8-c6df0d4501e1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1406 microversion: 2.20 time: 0.182946 Oct 28 08:48:14.241731 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 491/1036] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:14 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:48:15.121941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1305ddc9-5ef0-4060-9039-ab95c152f101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:15.122715 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1305ddc9-5ef0-4060-9039-ab95c152f101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:15.130356 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1305ddc9-5ef0-4060-9039-ab95c152f101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:15.130811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1305ddc9-5ef0-4060-9039-ab95c152f101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:15.131679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1305ddc9-5ef0-4060-9039-ab95c152f101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:15.132170 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1305ddc9-5ef0-4060-9039-ab95c152f101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:15.259059 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fa1d6cca-39b0-44a2-8b29-ee18fd208ae2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:15.259657 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fa1d6cca-39b0-44a2-8b29-ee18fd208ae2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:15.268346 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa1d6cca-39b0-44a2-8b29-ee18fd208ae2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:15.268792 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa1d6cca-39b0-44a2-8b29-ee18fd208ae2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:15.269620 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa1d6cca-39b0-44a2-8b29-ee18fd208ae2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:15.270146 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa1d6cca-39b0-44a2-8b29-ee18fd208ae2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:15.283864 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-1305ddc9-5ef0-4060-9039-ab95c152f101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:15.292550 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1305ddc9-5ef0-4060-9039-ab95c152f101 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1364 microversion: 2.1 time: 0.174911 Oct 28 08:48:15.293373 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 546/1037] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:15 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:15.421938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fa1d6cca-39b0-44a2-8b29-ee18fd208ae2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:15.432123 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fa1d6cca-39b0-44a2-8b29-ee18fd208ae2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:15.434562 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fa1d6cca-39b0-44a2-8b29-ee18fd208ae2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:15.435748 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fa1d6cca-39b0-44a2-8b29-ee18fd208ae2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1406 microversion: 2.20 time: 0.180543 Oct 28 08:48:15.436307 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 492/1038] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:15 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:48:16.310558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-342e76eb-8e4c-4584-98ff-4f2f4e2b4226 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:16.311234 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-342e76eb-8e4c-4584-98ff-4f2f4e2b4226 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:16.318805 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-342e76eb-8e4c-4584-98ff-4f2f4e2b4226 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:16.319323 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-342e76eb-8e4c-4584-98ff-4f2f4e2b4226 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:16.320118 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-342e76eb-8e4c-4584-98ff-4f2f4e2b4226 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:16.320605 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-342e76eb-8e4c-4584-98ff-4f2f4e2b4226 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:16.453748 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-52f0f4b0-1866-4bdf-b4e0-73a75a50ed55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:16.454571 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-52f0f4b0-1866-4bdf-b4e0-73a75a50ed55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:16.459465 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-342e76eb-8e4c-4584-98ff-4f2f4e2b4226 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:16.461005 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52f0f4b0-1866-4bdf-b4e0-73a75a50ed55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:16.461810 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52f0f4b0-1866-4bdf-b4e0-73a75a50ed55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:16.463193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52f0f4b0-1866-4bdf-b4e0-73a75a50ed55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:16.463821 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-52f0f4b0-1866-4bdf-b4e0-73a75a50ed55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:16.467603 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-342e76eb-8e4c-4584-98ff-4f2f4e2b4226 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1364 microversion: 2.1 time: 0.161095 Oct 28 08:48:16.468211 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 547/1039] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:16 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:16.604716 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-52f0f4b0-1866-4bdf-b4e0-73a75a50ed55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:16.613527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-52f0f4b0-1866-4bdf-b4e0-73a75a50ed55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:16.615075 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-52f0f4b0-1866-4bdf-b4e0-73a75a50ed55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:16.616177 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-52f0f4b0-1866-4bdf-b4e0-73a75a50ed55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1406 microversion: 2.20 time: 0.166451 Oct 28 08:48:16.616747 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 493/1040] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:16 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:48:17.038432 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-95806729-3f84-414b-aec8-f27d1f2ab46c req-bc7a1b11-b24e-445b-be57-197dcd038e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44471d5a-b894-4e3f-b59d-b03afd03839b", "name": "network-vif-plugged", "status": "completed", "tag": "21594cc8-c73a-42e8-9350-519f7620496e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:17.040449 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:17.040449 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:48:17.048787 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-95806729-3f84-414b-aec8-f27d1f2ab46c req-bc7a1b11-b24e-445b-be57-197dcd038e71 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:17.049332 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-95806729-3f84-414b-aec8-f27d1f2ab46c req-bc7a1b11-b24e-445b-be57-197dcd038e71 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:17.061505 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-95806729-3f84-414b-aec8-f27d1f2ab46c req-bc7a1b11-b24e-445b-be57-197dcd038e71 service nova] Creating event network-vif-plugged:21594cc8-c73a-42e8-9350-519f7620496e for instance 44471d5a-b894-4e3f-b59d-b03afd03839b on hv-cinder-81566 Oct 28 08:48:17.066800 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-95806729-3f84-414b-aec8-f27d1f2ab46c req-bc7a1b11-b24e-445b-be57-197dcd038e71 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032032 Oct 28 08:48:17.067797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 548/1041] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:48:17.484543 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d3c607a9-7464-4e47-af82-45d9d0410e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:17.485771 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d3c607a9-7464-4e47-af82-45d9d0410e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:17.492657 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d3c607a9-7464-4e47-af82-45d9d0410e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:17.493016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d3c607a9-7464-4e47-af82-45d9d0410e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:17.493813 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d3c607a9-7464-4e47-af82-45d9d0410e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:17.494248 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d3c607a9-7464-4e47-af82-45d9d0410e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:17.623451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d3c607a9-7464-4e47-af82-45d9d0410e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:17.633080 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d3c607a9-7464-4e47-af82-45d9d0410e72 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1364 microversion: 2.1 time: 0.152169 Oct 28 08:48:17.633736 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 494/1042] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:17 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:17.637449 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6c6088a6-e573-4670-ad9c-4c3c8a875791 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:17.638162 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6c6088a6-e573-4670-ad9c-4c3c8a875791 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:17.644796 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c6088a6-e573-4670-ad9c-4c3c8a875791 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:17.645322 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c6088a6-e573-4670-ad9c-4c3c8a875791 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:17.646109 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c6088a6-e573-4670-ad9c-4c3c8a875791 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:17.646537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6c6088a6-e573-4670-ad9c-4c3c8a875791 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:17.773806 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6c6088a6-e573-4670-ad9c-4c3c8a875791 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:17.782619 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6c6088a6-e573-4670-ad9c-4c3c8a875791 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:17.784457 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6c6088a6-e573-4670-ad9c-4c3c8a875791 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:17.785658 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6c6088a6-e573-4670-ad9c-4c3c8a875791 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1406 microversion: 2.20 time: 0.152653 Oct 28 08:48:17.786253 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 549/1043] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:17 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:48:18.650251 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-93ce067b-994a-4db6-9c07-59ba7044c095 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:18.651129 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-93ce067b-994a-4db6-9c07-59ba7044c095 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:18.658094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93ce067b-994a-4db6-9c07-59ba7044c095 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:18.658549 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93ce067b-994a-4db6-9c07-59ba7044c095 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:18.659573 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93ce067b-994a-4db6-9c07-59ba7044c095 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:18.659999 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93ce067b-994a-4db6-9c07-59ba7044c095 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:18.804475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ab01c8f7-1d9b-48ba-a349-343febbf9b56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:18.805190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ab01c8f7-1d9b-48ba-a349-343febbf9b56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:18.821876 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-93ce067b-994a-4db6-9c07-59ba7044c095 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:18.823415 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab01c8f7-1d9b-48ba-a349-343febbf9b56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:18.824030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab01c8f7-1d9b-48ba-a349-343febbf9b56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:18.825101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab01c8f7-1d9b-48ba-a349-343febbf9b56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:18.826145 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab01c8f7-1d9b-48ba-a349-343febbf9b56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:18.833266 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-93ce067b-994a-4db6-9c07-59ba7044c095 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1364 microversion: 2.1 time: 0.186557 Oct 28 08:48:18.834391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 495/1044] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:18 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:18.963989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ab01c8f7-1d9b-48ba-a349-343febbf9b56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:18.973107 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ab01c8f7-1d9b-48ba-a349-343febbf9b56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:18.974637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ab01c8f7-1d9b-48ba-a349-343febbf9b56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:18.976350 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ab01c8f7-1d9b-48ba-a349-343febbf9b56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1597 microversion: 2.20 time: 0.175095 Oct 28 08:48:18.976350 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 550/1045] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:48:18 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:48:18.994371 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d5dbce3f-0aed-424d-82be-379aa4aaf346 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:18.994953 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d5dbce3f-0aed-424d-82be-379aa4aaf346 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:19.001564 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d5dbce3f-0aed-424d-82be-379aa4aaf346 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:19.002060 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d5dbce3f-0aed-424d-82be-379aa4aaf346 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:19.002833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d5dbce3f-0aed-424d-82be-379aa4aaf346 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:19.003267 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d5dbce3f-0aed-424d-82be-379aa4aaf346 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:19.081733 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-a3f49eeb-5cea-422a-bb05-b47c60eaecdf req-062352a8-6eb7-4864-8513-c1f4cca1cb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d4d877-fc9e-4f25-a21c-219f08ecdcff", "name": "network-vif-plugged", "status": "completed", "tag": "0616e940-d1b6-4c1e-b63c-17fc1651dfba"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:19.083518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d5dbce3f-0aed-424d-82be-379aa4aaf346 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093179 Oct 28 08:48:19.083717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:19.083717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:48:19.084606 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 496/1046] 10.222.0.74 () {60 vars in 1315 bytes} [Thu Oct 28 08:48:18 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:19.091591 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-a3f49eeb-5cea-422a-bb05-b47c60eaecdf req-062352a8-6eb7-4864-8513-c1f4cca1cb79 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:19.092047 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-a3f49eeb-5cea-422a-bb05-b47c60eaecdf req-062352a8-6eb7-4864-8513-c1f4cca1cb79 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:19.107401 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-a3f49eeb-5cea-422a-bb05-b47c60eaecdf req-062352a8-6eb7-4864-8513-c1f4cca1cb79 service nova] Creating event network-vif-plugged:0616e940-d1b6-4c1e-b63c-17fc1651dfba for instance 60d4d877-fc9e-4f25-a21c-219f08ecdcff on hv-cinder-81566 Oct 28 08:48:19.113238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-a3f49eeb-5cea-422a-bb05-b47c60eaecdf req-062352a8-6eb7-4864-8513-c1f4cca1cb79 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035425 Oct 28 08:48:19.114233 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 551/1047] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:48:19.851743 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bcdbd92b-b341-4ec8-aae6-33faa5eae77b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:19.852294 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bcdbd92b-b341-4ec8-aae6-33faa5eae77b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:19.858157 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bcdbd92b-b341-4ec8-aae6-33faa5eae77b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:19.858601 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bcdbd92b-b341-4ec8-aae6-33faa5eae77b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:19.859363 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bcdbd92b-b341-4ec8-aae6-33faa5eae77b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:19.860455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bcdbd92b-b341-4ec8-aae6-33faa5eae77b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:20.088805 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-bcdbd92b-b341-4ec8-aae6-33faa5eae77b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:20.097599 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bcdbd92b-b341-4ec8-aae6-33faa5eae77b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1364 microversion: 2.1 time: 0.250022 Oct 28 08:48:20.098332 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 497/1048] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:19 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:20.168208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e5c22858-5a24-4b2b-9a81-a2773ee37c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:20.169859 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e5c22858-5a24-4b2b-9a81-a2773ee37c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:20.170043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-4d2dbab5-8901-4270-b505-e11173e214e9 req-26233c34-8952-4ed1-a1b4-59a566ab6982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44471d5a-b894-4e3f-b59d-b03afd03839b", "tag": "21594cc8-c73a-42e8-9350-519f7620496e"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:20.171670 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:20.171670 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:48:20.177682 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e5c22858-5a24-4b2b-9a81-a2773ee37c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:20.178163 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e5c22858-5a24-4b2b-9a81-a2773ee37c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:20.178942 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e5c22858-5a24-4b2b-9a81-a2773ee37c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:20.179371 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e5c22858-5a24-4b2b-9a81-a2773ee37c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:20.179479 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-4d2dbab5-8901-4270-b505-e11173e214e9 req-26233c34-8952-4ed1-a1b4-59a566ab6982 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:20.179981 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-4d2dbab5-8901-4270-b505-e11173e214e9 req-26233c34-8952-4ed1-a1b4-59a566ab6982 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:20.200123 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-4d2dbab5-8901-4270-b505-e11173e214e9 req-26233c34-8952-4ed1-a1b4-59a566ab6982 service nova] Creating event network-changed:21594cc8-c73a-42e8-9350-519f7620496e for instance 44471d5a-b894-4e3f-b59d-b03afd03839b on hv-cinder-81566 Oct 28 08:48:20.206750 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-4d2dbab5-8901-4270-b505-e11173e214e9 req-26233c34-8952-4ed1-a1b4-59a566ab6982 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040146 Oct 28 08:48:20.207660 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 498/1049] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:20.255541 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e5c22858-5a24-4b2b-9a81-a2773ee37c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.091091 Oct 28 08:48:20.256859 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 552/1050] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:20 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:21.116144 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b65a4b64-06ac-4ed3-bea9-8c4a6f9fd6f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:21.116929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b65a4b64-06ac-4ed3-bea9-8c4a6f9fd6f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:21.124296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b65a4b64-06ac-4ed3-bea9-8c4a6f9fd6f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:21.124820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b65a4b64-06ac-4ed3-bea9-8c4a6f9fd6f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:21.126923 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b65a4b64-06ac-4ed3-bea9-8c4a6f9fd6f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:21.127427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b65a4b64-06ac-4ed3-bea9-8c4a6f9fd6f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:21.267385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a6288910-60f3-4afc-a00f-f09b386c81a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:21.268445 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a6288910-60f3-4afc-a00f-f09b386c81a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:21.275380 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6288910-60f3-4afc-a00f-f09b386c81a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:21.275828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6288910-60f3-4afc-a00f-f09b386c81a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:21.276603 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6288910-60f3-4afc-a00f-f09b386c81a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:21.279981 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b65a4b64-06ac-4ed3-bea9-8c4a6f9fd6f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:21.288432 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b65a4b64-06ac-4ed3-bea9-8c4a6f9fd6f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1549 microversion: 2.1 time: 0.176356 Oct 28 08:48:21.289026 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 499/1051] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:21 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:21.289343 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6288910-60f3-4afc-a00f-f09b386c81a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:21.305371 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-254b093c-8533-428f-b439-ed3c26236555 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:21.305924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-254b093c-8533-428f-b439-ed3c26236555 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:21.311622 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-254b093c-8533-428f-b439-ed3c26236555 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:21.312063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-254b093c-8533-428f-b439-ed3c26236555 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:21.313583 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-254b093c-8533-428f-b439-ed3c26236555 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:21.314038 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-254b093c-8533-428f-b439-ed3c26236555 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:21.354966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a6288910-60f3-4afc-a00f-f09b386c81a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.092041 Oct 28 08:48:21.355879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 553/1052] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:21 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:21.405322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-254b093c-8533-428f-b439-ed3c26236555 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103308 Oct 28 08:48:21.406099 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 500/1053] 10.222.0.74 () {58 vars in 1274 bytes} [Thu Oct 28 08:48:21 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:48:22.367814 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-08ed80a7-d417-4bd6-8063-fc03292569d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:22.369127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-08ed80a7-d417-4bd6-8063-fc03292569d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:22.376980 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08ed80a7-d417-4bd6-8063-fc03292569d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:22.377518 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08ed80a7-d417-4bd6-8063-fc03292569d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:22.378555 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08ed80a7-d417-4bd6-8063-fc03292569d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:22.379054 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-08ed80a7-d417-4bd6-8063-fc03292569d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:22.411310 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a16b37fc-08e0-4070-bf47-60a13b5cc3b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:22.412222 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a16b37fc-08e0-4070-bf47-60a13b5cc3b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:22.418963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a16b37fc-08e0-4070-bf47-60a13b5cc3b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:22.419403 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a16b37fc-08e0-4070-bf47-60a13b5cc3b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:22.420168 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a16b37fc-08e0-4070-bf47-60a13b5cc3b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:22.420599 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a16b37fc-08e0-4070-bf47-60a13b5cc3b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:22.449861 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-08ed80a7-d417-4bd6-8063-fc03292569d6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.086061 Oct 28 08:48:22.453178 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 554/1054] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:22 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:22.456666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-54c73fd5-5bd5-4978-827c-3d28ab7fa4d9 req-d9617223-1f77-4d1f-95eb-6eff22728da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d4d877-fc9e-4f25-a21c-219f08ecdcff", "tag": "0616e940-d1b6-4c1e-b63c-17fc1651dfba"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:22.458374 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:22.458374 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:48:22.466235 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-54c73fd5-5bd5-4978-827c-3d28ab7fa4d9 req-d9617223-1f77-4d1f-95eb-6eff22728da7 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:22.466753 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-54c73fd5-5bd5-4978-827c-3d28ab7fa4d9 req-d9617223-1f77-4d1f-95eb-6eff22728da7 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:22.478513 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-54c73fd5-5bd5-4978-827c-3d28ab7fa4d9 req-d9617223-1f77-4d1f-95eb-6eff22728da7 service nova] Creating event network-changed:0616e940-d1b6-4c1e-b63c-17fc1651dfba for instance 60d4d877-fc9e-4f25-a21c-219f08ecdcff on hv-cinder-81566 Oct 28 08:48:22.480125 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a16b37fc-08e0-4070-bf47-60a13b5cc3b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.074762 Oct 28 08:48:22.483401 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 501/1055] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:22 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:48:22.483561 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-54c73fd5-5bd5-4978-827c-3d28ab7fa4d9 req-d9617223-1f77-4d1f-95eb-6eff22728da7 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031407 Oct 28 08:48:22.484032 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 555/1056] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:23.461209 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6c5a17e6-356a-4228-99e3-c1f16c7a228a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:23.462143 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6c5a17e6-356a-4228-99e3-c1f16c7a228a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:23.468993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6c5a17e6-356a-4228-99e3-c1f16c7a228a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:23.469725 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6c5a17e6-356a-4228-99e3-c1f16c7a228a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:23.470358 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6c5a17e6-356a-4228-99e3-c1f16c7a228a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:23.470793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6c5a17e6-356a-4228-99e3-c1f16c7a228a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:23.493440 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-47b5b40c-2cb0-4983-b921-01282e96fbab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:23.494621 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-47b5b40c-2cb0-4983-b921-01282e96fbab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:23.502091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-47b5b40c-2cb0-4983-b921-01282e96fbab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:23.502521 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-47b5b40c-2cb0-4983-b921-01282e96fbab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:23.503297 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-47b5b40c-2cb0-4983-b921-01282e96fbab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:23.503720 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-47b5b40c-2cb0-4983-b921-01282e96fbab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:23.540006 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6c5a17e6-356a-4228-99e3-c1f16c7a228a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.082769 Oct 28 08:48:23.543168 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 502/1057] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:23 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:23.571839 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-47b5b40c-2cb0-4983-b921-01282e96fbab tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.082813 Oct 28 08:48:23.572641 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 556/1058] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:23 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:48:24.551828 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0f4ad423-a222-4ba6-a2b1-c70140da5ef7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:24.552868 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0f4ad423-a222-4ba6-a2b1-c70140da5ef7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:24.559904 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f4ad423-a222-4ba6-a2b1-c70140da5ef7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.560351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f4ad423-a222-4ba6-a2b1-c70140da5ef7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.561192 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f4ad423-a222-4ba6-a2b1-c70140da5ef7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.561661 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f4ad423-a222-4ba6-a2b1-c70140da5ef7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.583834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-279ed036-1ea7-47c1-82c8-14e3a2004929 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:24.584841 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-279ed036-1ea7-47c1-82c8-14e3a2004929 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:24.592430 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-279ed036-1ea7-47c1-82c8-14e3a2004929 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.593089 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-279ed036-1ea7-47c1-82c8-14e3a2004929 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.593993 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-279ed036-1ea7-47c1-82c8-14e3a2004929 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.594722 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-279ed036-1ea7-47c1-82c8-14e3a2004929 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.628202 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0f4ad423-a222-4ba6-a2b1-c70140da5ef7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.080530 Oct 28 08:48:24.628755 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 503/1059] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:24 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:24.658640 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-279ed036-1ea7-47c1-82c8-14e3a2004929 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.078731 Oct 28 08:48:24.659530 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 557/1060] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:24 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:25.640162 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a99269d8-47f3-41dc-bd58-90ae3194cc75 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:25.641183 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a99269d8-47f3-41dc-bd58-90ae3194cc75 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:25.648994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a99269d8-47f3-41dc-bd58-90ae3194cc75 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:25.649367 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a99269d8-47f3-41dc-bd58-90ae3194cc75 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:25.650182 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a99269d8-47f3-41dc-bd58-90ae3194cc75 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:25.650605 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a99269d8-47f3-41dc-bd58-90ae3194cc75 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:25.670425 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3e3ccc37-afdc-43df-9171-4d17323b4873 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:25.671532 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3e3ccc37-afdc-43df-9171-4d17323b4873 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:25.681677 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e3ccc37-afdc-43df-9171-4d17323b4873 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:25.682611 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e3ccc37-afdc-43df-9171-4d17323b4873 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:25.684094 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e3ccc37-afdc-43df-9171-4d17323b4873 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:25.684886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3e3ccc37-afdc-43df-9171-4d17323b4873 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:25.719844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a99269d8-47f3-41dc-bd58-90ae3194cc75 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.083821 Oct 28 08:48:25.721255 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 504/1061] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:25 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:25.763911 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3e3ccc37-afdc-43df-9171-4d17323b4873 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.097593 Oct 28 08:48:25.764842 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 558/1062] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:25 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:26.734741 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-92491da9-814b-4e85-997f-43dc8f22de68 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:26.736900 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-92491da9-814b-4e85-997f-43dc8f22de68 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:26.743694 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92491da9-814b-4e85-997f-43dc8f22de68 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:26.744134 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92491da9-814b-4e85-997f-43dc8f22de68 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:26.744894 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92491da9-814b-4e85-997f-43dc8f22de68 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:26.745321 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92491da9-814b-4e85-997f-43dc8f22de68 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:26.774856 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-48ed4ba7-8da4-4fc2-bfdd-0cae1fcd2a70 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:26.775925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-48ed4ba7-8da4-4fc2-bfdd-0cae1fcd2a70 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:26.783299 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48ed4ba7-8da4-4fc2-bfdd-0cae1fcd2a70 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:26.783299 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48ed4ba7-8da4-4fc2-bfdd-0cae1fcd2a70 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:26.784747 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48ed4ba7-8da4-4fc2-bfdd-0cae1fcd2a70 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:26.785179 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48ed4ba7-8da4-4fc2-bfdd-0cae1fcd2a70 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:26.810733 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-92491da9-814b-4e85-997f-43dc8f22de68 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.079859 Oct 28 08:48:26.811381 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 505/1063] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:26 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:26.864591 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-48ed4ba7-8da4-4fc2-bfdd-0cae1fcd2a70 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.093607 Oct 28 08:48:26.865242 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 559/1064] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:26 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:27.822138 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a29657e9-fee8-48dc-950a-0344b5dac787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:27.823143 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a29657e9-fee8-48dc-950a-0344b5dac787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:27.830771 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a29657e9-fee8-48dc-950a-0344b5dac787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:27.831208 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a29657e9-fee8-48dc-950a-0344b5dac787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:27.831974 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a29657e9-fee8-48dc-950a-0344b5dac787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:27.832409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a29657e9-fee8-48dc-950a-0344b5dac787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:27.875727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3a12d6e8-c331-4cc9-9402-d57eb582bb68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:27.877380 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3a12d6e8-c331-4cc9-9402-d57eb582bb68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:27.884290 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3a12d6e8-c331-4cc9-9402-d57eb582bb68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:27.884740 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3a12d6e8-c331-4cc9-9402-d57eb582bb68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:27.885506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3a12d6e8-c331-4cc9-9402-d57eb582bb68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:27.885976 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3a12d6e8-c331-4cc9-9402-d57eb582bb68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:27.896238 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a29657e9-fee8-48dc-950a-0344b5dac787 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.078151 Oct 28 08:48:27.899645 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 506/1065] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:27 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:27.961351 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3a12d6e8-c331-4cc9-9402-d57eb582bb68 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.088991 Oct 28 08:48:27.962032 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 560/1066] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:27 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:28.908160 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-89d0a9ab-4fba-4ed1-a83f-ae212be86108 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:28.909612 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-89d0a9ab-4fba-4ed1-a83f-ae212be86108 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:28.916408 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-89d0a9ab-4fba-4ed1-a83f-ae212be86108 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.916844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-89d0a9ab-4fba-4ed1-a83f-ae212be86108 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.917591 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-89d0a9ab-4fba-4ed1-a83f-ae212be86108 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.918053 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-89d0a9ab-4fba-4ed1-a83f-ae212be86108 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.973207 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9a80e01a-aa60-4de9-bb7c-5635226696a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:28.974293 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9a80e01a-aa60-4de9-bb7c-5635226696a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:28.981250 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9a80e01a-aa60-4de9-bb7c-5635226696a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.981696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9a80e01a-aa60-4de9-bb7c-5635226696a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.982501 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9a80e01a-aa60-4de9-bb7c-5635226696a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.982930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9a80e01a-aa60-4de9-bb7c-5635226696a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.985346 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-89d0a9ab-4fba-4ed1-a83f-ae212be86108 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.081619 Oct 28 08:48:28.986711 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 507/1067] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:28 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:29.044819 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9a80e01a-aa60-4de9-bb7c-5635226696a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.075687 Oct 28 08:48:29.045461 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 561/1068] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:28 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:29.997007 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c39b3083-4aa6-43c1-b1b7-6a234adc5f53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:29.998063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c39b3083-4aa6-43c1-b1b7-6a234adc5f53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:30.005714 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c39b3083-4aa6-43c1-b1b7-6a234adc5f53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:30.006194 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c39b3083-4aa6-43c1-b1b7-6a234adc5f53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:30.006975 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c39b3083-4aa6-43c1-b1b7-6a234adc5f53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:30.007407 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c39b3083-4aa6-43c1-b1b7-6a234adc5f53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:30.056820 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e35dfaea-9e15-40a8-827e-d8f76a977ae3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:30.057871 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e35dfaea-9e15-40a8-827e-d8f76a977ae3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:30.065466 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e35dfaea-9e15-40a8-827e-d8f76a977ae3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:30.065942 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e35dfaea-9e15-40a8-827e-d8f76a977ae3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:30.066717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e35dfaea-9e15-40a8-827e-d8f76a977ae3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:30.067147 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e35dfaea-9e15-40a8-827e-d8f76a977ae3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:30.075808 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c39b3083-4aa6-43c1-b1b7-6a234adc5f53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.082605 Oct 28 08:48:30.079043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 508/1069] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:29 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:30.146542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e35dfaea-9e15-40a8-827e-d8f76a977ae3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.093484 Oct 28 08:48:30.147233 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 562/1070] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:30 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:31.088381 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-27a6dd39-eb3d-4c15-933b-eb05e6a320c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:31.089262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-27a6dd39-eb3d-4c15-933b-eb05e6a320c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:31.097388 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-27a6dd39-eb3d-4c15-933b-eb05e6a320c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:31.097984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-27a6dd39-eb3d-4c15-933b-eb05e6a320c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:31.098809 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-27a6dd39-eb3d-4c15-933b-eb05e6a320c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:31.099330 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-27a6dd39-eb3d-4c15-933b-eb05e6a320c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:31.157544 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dd0bee27-0b68-4e93-959c-e0b30046f42d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:31.158575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dd0bee27-0b68-4e93-959c-e0b30046f42d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:31.165641 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd0bee27-0b68-4e93-959c-e0b30046f42d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:31.166111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd0bee27-0b68-4e93-959c-e0b30046f42d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:31.166877 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd0bee27-0b68-4e93-959c-e0b30046f42d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:31.167306 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dd0bee27-0b68-4e93-959c-e0b30046f42d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:31.167539 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-27a6dd39-eb3d-4c15-933b-eb05e6a320c4 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.083540 Oct 28 08:48:31.168347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 509/1071] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:31 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:31.227148 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dd0bee27-0b68-4e93-959c-e0b30046f42d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.073527 Oct 28 08:48:31.227795 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 563/1072] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:31 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:32.186362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e6253182-75df-4e94-870b-103f1b887b2b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:32.187385 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e6253182-75df-4e94-870b-103f1b887b2b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:32.195595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e6253182-75df-4e94-870b-103f1b887b2b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:32.196048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e6253182-75df-4e94-870b-103f1b887b2b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:32.196816 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e6253182-75df-4e94-870b-103f1b887b2b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:32.197278 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e6253182-75df-4e94-870b-103f1b887b2b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:32.240378 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b73d59e8-9326-4dd9-b0bc-f893a56e79fe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:32.241398 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b73d59e8-9326-4dd9-b0bc-f893a56e79fe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:32.248416 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b73d59e8-9326-4dd9-b0bc-f893a56e79fe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:32.248854 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b73d59e8-9326-4dd9-b0bc-f893a56e79fe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:32.249631 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b73d59e8-9326-4dd9-b0bc-f893a56e79fe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:32.250094 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b73d59e8-9326-4dd9-b0bc-f893a56e79fe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:32.270302 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e6253182-75df-4e94-870b-103f1b887b2b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 14 microversion: 2.20 time: 0.087867 Oct 28 08:48:32.270951 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 510/1073] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:32 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:32.327420 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b73d59e8-9326-4dd9-b0bc-f893a56e79fe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.092529 Oct 28 08:48:32.328091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 564/1074] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:32 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:33.282351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-afea3a6b-397e-4692-bf19-21929f91531d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:33.284703 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-afea3a6b-397e-4692-bf19-21929f91531d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:33.291558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-afea3a6b-397e-4692-bf19-21929f91531d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:33.291998 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-afea3a6b-397e-4692-bf19-21929f91531d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:33.292756 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-afea3a6b-397e-4692-bf19-21929f91531d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:33.293186 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-afea3a6b-397e-4692-bf19-21929f91531d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:33.339861 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0c91ca4b-c5f8-42a9-b95c-bdbc5b5d98e2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:33.340908 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0c91ca4b-c5f8-42a9-b95c-bdbc5b5d98e2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:33.347994 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c91ca4b-c5f8-42a9-b95c-bdbc5b5d98e2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:33.348443 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c91ca4b-c5f8-42a9-b95c-bdbc5b5d98e2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:33.349211 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c91ca4b-c5f8-42a9-b95c-bdbc5b5d98e2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:33.349643 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c91ca4b-c5f8-42a9-b95c-bdbc5b5d98e2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:33.378142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-afea3a6b-397e-4692-bf19-21929f91531d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 9954 microversion: 2.20 time: 0.099596 Oct 28 08:48:33.378825 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 511/1075] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:33 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 9954 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:48:33.414454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0c91ca4b-c5f8-42a9-b95c-bdbc5b5d98e2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 14 microversion: 2.1 time: 0.078501 Oct 28 08:48:33.415115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 565/1076] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:33 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:34.390328 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e3c8c004-c5ea-4c73-aee8-59b6d5446f86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:34.391245 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e3c8c004-c5ea-4c73-aee8-59b6d5446f86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:34.398250 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c8c004-c5ea-4c73-aee8-59b6d5446f86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:34.398696 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c8c004-c5ea-4c73-aee8-59b6d5446f86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:34.399460 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c8c004-c5ea-4c73-aee8-59b6d5446f86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:34.399894 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3c8c004-c5ea-4c73-aee8-59b6d5446f86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:34.426489 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-095bf851-db86-4148-ae91-90bc1dfe8521 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:34.427577 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-095bf851-db86-4148-ae91-90bc1dfe8521 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:34.434806 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-095bf851-db86-4148-ae91-90bc1dfe8521 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:34.435244 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-095bf851-db86-4148-ae91-90bc1dfe8521 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:34.436011 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-095bf851-db86-4148-ae91-90bc1dfe8521 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:34.436449 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-095bf851-db86-4148-ae91-90bc1dfe8521 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:34.485014 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e3c8c004-c5ea-4c73-aee8-59b6d5446f86 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 15612 microversion: 2.20 time: 0.098701 Oct 28 08:48:34.486068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 512/1077] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:34 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 15612 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:34.545022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-095bf851-db86-4148-ae91-90bc1dfe8521 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 6451 microversion: 2.1 time: 0.123961 Oct 28 08:48:34.545666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 566/1078] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:34 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 6451 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:35.497351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b38afb8d-f451-4337-8433-1cb96e287906 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:35.498384 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b38afb8d-f451-4337-8433-1cb96e287906 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:35.506096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b38afb8d-f451-4337-8433-1cb96e287906 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:35.506548 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b38afb8d-f451-4337-8433-1cb96e287906 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:35.507312 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b38afb8d-f451-4337-8433-1cb96e287906 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:35.507764 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b38afb8d-f451-4337-8433-1cb96e287906 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:35.556213 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-468de5c5-2450-4428-aff2-411754c49299 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:35.557317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-468de5c5-2450-4428-aff2-411754c49299 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:35.564962 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-468de5c5-2450-4428-aff2-411754c49299 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:35.565408 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-468de5c5-2450-4428-aff2-411754c49299 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:35.573364 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-468de5c5-2450-4428-aff2-411754c49299 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:35.573829 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-468de5c5-2450-4428-aff2-411754c49299 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:35.583207 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b38afb8d-f451-4337-8433-1cb96e287906 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 17861 microversion: 2.20 time: 0.089743 Oct 28 08:48:35.584751 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 513/1079] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:35 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 17861 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:35.677592 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-468de5c5-2450-4428-aff2-411754c49299 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 13887 microversion: 2.1 time: 0.125299 Oct 28 08:48:35.678305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 567/1080] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:35 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 13887 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:36.595531 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8fa95e54-cd40-48fc-b65a-051840e9ff27 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:36.596819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8fa95e54-cd40-48fc-b65a-051840e9ff27 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:36.604076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8fa95e54-cd40-48fc-b65a-051840e9ff27 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:36.604523 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8fa95e54-cd40-48fc-b65a-051840e9ff27 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:36.605313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8fa95e54-cd40-48fc-b65a-051840e9ff27 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:36.605750 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8fa95e54-cd40-48fc-b65a-051840e9ff27 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:36.690078 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ff2573b8-eb34-4006-84d2-e15afac8f739 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:36.690972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ff2573b8-eb34-4006-84d2-e15afac8f739 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:36.698094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8fa95e54-cd40-48fc-b65a-051840e9ff27 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 19342 microversion: 2.20 time: 0.106680 Oct 28 08:48:36.698288 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ff2573b8-eb34-4006-84d2-e15afac8f739 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:36.698656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ff2573b8-eb34-4006-84d2-e15afac8f739 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:36.698819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 514/1081] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:36 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 19342 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:36.699439 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ff2573b8-eb34-4006-84d2-e15afac8f739 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:36.699872 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ff2573b8-eb34-4006-84d2-e15afac8f739 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:36.780250 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ff2573b8-eb34-4006-84d2-e15afac8f739 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 18350 microversion: 2.1 time: 0.095040 Oct 28 08:48:36.780903 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 568/1082] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:36 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 18350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:37.710874 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1f62081f-bccd-43e3-8104-c7ee63bfe47b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:37.711912 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1f62081f-bccd-43e3-8104-c7ee63bfe47b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:37.719507 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f62081f-bccd-43e3-8104-c7ee63bfe47b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:37.719951 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f62081f-bccd-43e3-8104-c7ee63bfe47b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:37.721518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f62081f-bccd-43e3-8104-c7ee63bfe47b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:37.721985 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1f62081f-bccd-43e3-8104-c7ee63bfe47b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:37.793051 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5c45091f-5e82-4978-a326-1b3ec7a6a67a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:37.794083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5c45091f-5e82-4978-a326-1b3ec7a6a67a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:37.800906 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c45091f-5e82-4978-a326-1b3ec7a6a67a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:37.801556 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1f62081f-bccd-43e3-8104-c7ee63bfe47b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 22021 microversion: 2.20 time: 0.094651 Oct 28 08:48:37.801723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c45091f-5e82-4978-a326-1b3ec7a6a67a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:37.805380 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 515/1083] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:37 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 22021 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:37.805531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c45091f-5e82-4978-a326-1b3ec7a6a67a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:37.805531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5c45091f-5e82-4978-a326-1b3ec7a6a67a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:37.889383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5c45091f-5e82-4978-a326-1b3ec7a6a67a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 19227 microversion: 2.1 time: 0.100731 Oct 28 08:48:37.890079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 569/1084] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:37 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 19227 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:38.814818 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-39ee4080-5306-4d3c-9703-adbf25f5ad06 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:38.815956 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-39ee4080-5306-4d3c-9703-adbf25f5ad06 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:38.823157 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-39ee4080-5306-4d3c-9703-adbf25f5ad06 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.823597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-39ee4080-5306-4d3c-9703-adbf25f5ad06 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.824360 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-39ee4080-5306-4d3c-9703-adbf25f5ad06 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.824787 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-39ee4080-5306-4d3c-9703-adbf25f5ad06 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.901114 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c2f036ce-f1d7-4f23-8e0e-8521030132a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:38.901745 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-39ee4080-5306-4d3c-9703-adbf25f5ad06 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 23235 microversion: 2.20 time: 0.092113 Oct 28 08:48:38.902283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c2f036ce-f1d7-4f23-8e0e-8521030132a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:38.902495 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 516/1085] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:38 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 23235 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:38.911861 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c2f036ce-f1d7-4f23-8e0e-8521030132a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.912507 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c2f036ce-f1d7-4f23-8e0e-8521030132a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.913363 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c2f036ce-f1d7-4f23-8e0e-8521030132a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.913811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c2f036ce-f1d7-4f23-8e0e-8521030132a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.997596 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c2f036ce-f1d7-4f23-8e0e-8521030132a3 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 21513 microversion: 2.1 time: 0.100271 Oct 28 08:48:38.998217 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 570/1086] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:38 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 21513 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:39.915120 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8b6dc38c-1491-4ee6-99b4-09cea6a8197f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:39.916103 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8b6dc38c-1491-4ee6-99b4-09cea6a8197f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:39.922841 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8b6dc38c-1491-4ee6-99b4-09cea6a8197f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:39.923869 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8b6dc38c-1491-4ee6-99b4-09cea6a8197f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:39.924707 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8b6dc38c-1491-4ee6-99b4-09cea6a8197f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:39.925131 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8b6dc38c-1491-4ee6-99b4-09cea6a8197f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:40.009562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2bfa6991-7a0d-4385-92a1-a3fcd4fa72fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:40.010511 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2bfa6991-7a0d-4385-92a1-a3fcd4fa72fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:40.015461 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8b6dc38c-1491-4ee6-99b4-09cea6a8197f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 24340 microversion: 2.20 time: 0.104373 Oct 28 08:48:40.019434 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 517/1087] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:39 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 24340 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:40.019604 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2bfa6991-7a0d-4385-92a1-a3fcd4fa72fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:40.019604 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2bfa6991-7a0d-4385-92a1-a3fcd4fa72fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:40.019865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2bfa6991-7a0d-4385-92a1-a3fcd4fa72fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:40.020274 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2bfa6991-7a0d-4385-92a1-a3fcd4fa72fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:40.102536 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2bfa6991-7a0d-4385-92a1-a3fcd4fa72fc tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 23175 microversion: 2.1 time: 0.096956 Oct 28 08:48:40.103310 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 571/1088] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:40 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 23175 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:41.027780 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-34ac4dea-e751-4c21-8371-ebbd5ab2b96f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:41.028785 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-34ac4dea-e751-4c21-8371-ebbd5ab2b96f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:41.036240 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-34ac4dea-e751-4c21-8371-ebbd5ab2b96f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:41.036693 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-34ac4dea-e751-4c21-8371-ebbd5ab2b96f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:41.037461 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-34ac4dea-e751-4c21-8371-ebbd5ab2b96f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:41.037929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-34ac4dea-e751-4c21-8371-ebbd5ab2b96f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:41.115428 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9e85fb1d-17b4-4170-809c-b4d0b1b88bbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:41.116429 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9e85fb1d-17b4-4170-809c-b4d0b1b88bbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:41.124120 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9e85fb1d-17b4-4170-809c-b4d0b1b88bbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:41.124289 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-34ac4dea-e751-4c21-8371-ebbd5ab2b96f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 25571 microversion: 2.20 time: 0.100416 Oct 28 08:48:41.124571 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9e85fb1d-17b4-4170-809c-b4d0b1b88bbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:41.125181 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 518/1089] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:41 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 25571 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:41.125375 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9e85fb1d-17b4-4170-809c-b4d0b1b88bbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:41.125833 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9e85fb1d-17b4-4170-809c-b4d0b1b88bbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:41.208985 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9e85fb1d-17b4-4170-809c-b4d0b1b88bbf tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 24623 microversion: 2.1 time: 0.097667 Oct 28 08:48:41.209648 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 572/1090] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:41 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 24623 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:42.137040 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8da552ff-cb32-40b9-bdc9-e335eba1086a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:42.140849 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8da552ff-cb32-40b9-bdc9-e335eba1086a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:42.148423 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8da552ff-cb32-40b9-bdc9-e335eba1086a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.148904 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8da552ff-cb32-40b9-bdc9-e335eba1086a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.149684 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8da552ff-cb32-40b9-bdc9-e335eba1086a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.150146 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8da552ff-cb32-40b9-bdc9-e335eba1086a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.222437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d5913180-bdbc-4c34-81ed-74ccf812c1a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:42.223444 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d5913180-bdbc-4c34-81ed-74ccf812c1a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:42.230374 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5913180-bdbc-4c34-81ed-74ccf812c1a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.230825 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5913180-bdbc-4c34-81ed-74ccf812c1a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.231590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5913180-bdbc-4c34-81ed-74ccf812c1a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.232029 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5913180-bdbc-4c34-81ed-74ccf812c1a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.237057 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8da552ff-cb32-40b9-bdc9-e335eba1086a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 26828 microversion: 2.20 time: 0.103950 Oct 28 08:48:42.237988 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 519/1091] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:42 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 26828 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:42.306516 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d5913180-bdbc-4c34-81ed-74ccf812c1a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 25952 microversion: 2.1 time: 0.089662 Oct 28 08:48:42.307172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 573/1092] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:42 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 25952 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:43.249292 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3ef8aede-8a99-44b4-a35a-28a3b38c8b31 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:43.250301 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3ef8aede-8a99-44b4-a35a-28a3b38c8b31 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:43.257173 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3ef8aede-8a99-44b4-a35a-28a3b38c8b31 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:43.257615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3ef8aede-8a99-44b4-a35a-28a3b38c8b31 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:43.258417 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3ef8aede-8a99-44b4-a35a-28a3b38c8b31 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:43.258856 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3ef8aede-8a99-44b4-a35a-28a3b38c8b31 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:43.319101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-35a1e65c-b486-4424-8e37-a18d55201ac6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:43.320225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-35a1e65c-b486-4424-8e37-a18d55201ac6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:43.327229 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35a1e65c-b486-4424-8e37-a18d55201ac6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:43.327677 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35a1e65c-b486-4424-8e37-a18d55201ac6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:43.328456 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35a1e65c-b486-4424-8e37-a18d55201ac6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:43.328893 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-35a1e65c-b486-4424-8e37-a18d55201ac6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:43.343234 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3ef8aede-8a99-44b4-a35a-28a3b38c8b31 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 27655 microversion: 2.20 time: 0.097835 Oct 28 08:48:43.344183 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 520/1093] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:43 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 27655 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:43.415865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-35a1e65c-b486-4424-8e37-a18d55201ac6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 27152 microversion: 2.1 time: 0.101025 Oct 28 08:48:43.416516 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 574/1094] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:43 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 27152 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:44.356315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c6d82845-7e23-4695-895b-5eedc9553e2e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:44.357217 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c6d82845-7e23-4695-895b-5eedc9553e2e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:44.364899 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6d82845-7e23-4695-895b-5eedc9553e2e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:44.365346 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6d82845-7e23-4695-895b-5eedc9553e2e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:44.366198 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6d82845-7e23-4695-895b-5eedc9553e2e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:44.366581 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6d82845-7e23-4695-895b-5eedc9553e2e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:44.428188 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d4314481-f884-4edd-be18-97f592fa9940 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:44.429222 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d4314481-f884-4edd-be18-97f592fa9940 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:44.438287 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d4314481-f884-4edd-be18-97f592fa9940 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:44.438733 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d4314481-f884-4edd-be18-97f592fa9940 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:44.439565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d4314481-f884-4edd-be18-97f592fa9940 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:44.440143 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d4314481-f884-4edd-be18-97f592fa9940 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:44.451521 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c6d82845-7e23-4695-895b-5eedc9553e2e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 27967 microversion: 2.20 time: 0.099226 Oct 28 08:48:44.452175 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 521/1095] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:44 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 27967 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:44.519310 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d4314481-f884-4edd-be18-97f592fa9940 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 27715 microversion: 2.1 time: 0.095031 Oct 28 08:48:44.519967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 575/1096] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:44 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 27715 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:45.464496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-be27269e-7449-4a1b-8e9c-7ab9bae21d10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:45.465498 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-be27269e-7449-4a1b-8e9c-7ab9bae21d10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:45.473427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-be27269e-7449-4a1b-8e9c-7ab9bae21d10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:45.473901 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-be27269e-7449-4a1b-8e9c-7ab9bae21d10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:45.474685 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-be27269e-7449-4a1b-8e9c-7ab9bae21d10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:45.475116 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-be27269e-7449-4a1b-8e9c-7ab9bae21d10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:45.531627 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7a57cbb3-54fc-4896-b19a-eeff7f205b7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:45.533126 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7a57cbb3-54fc-4896-b19a-eeff7f205b7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:45.540370 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a57cbb3-54fc-4896-b19a-eeff7f205b7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:45.540815 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a57cbb3-54fc-4896-b19a-eeff7f205b7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:45.541582 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a57cbb3-54fc-4896-b19a-eeff7f205b7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:45.542046 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a57cbb3-54fc-4896-b19a-eeff7f205b7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:45.564086 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-be27269e-7449-4a1b-8e9c-7ab9bae21d10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28085 microversion: 2.20 time: 0.103471 Oct 28 08:48:45.565027 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 522/1097] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:45 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28085 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:45.638320 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7a57cbb3-54fc-4896-b19a-eeff7f205b7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28025 microversion: 2.1 time: 0.110673 Oct 28 08:48:45.639003 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 576/1098] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:45 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28025 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:46.576741 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5aab64bb-0e20-44c2-bbf9-41cb2629c582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:46.577865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5aab64bb-0e20-44c2-bbf9-41cb2629c582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:46.585451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5aab64bb-0e20-44c2-bbf9-41cb2629c582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:46.585929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5aab64bb-0e20-44c2-bbf9-41cb2629c582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:46.586703 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5aab64bb-0e20-44c2-bbf9-41cb2629c582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:46.587140 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5aab64bb-0e20-44c2-bbf9-41cb2629c582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:46.651417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b8a00ad5-98ee-47a4-bde7-b5e8c44e757d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:46.652415 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b8a00ad5-98ee-47a4-bde7-b5e8c44e757d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:46.660574 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8a00ad5-98ee-47a4-bde7-b5e8c44e757d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:46.661014 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8a00ad5-98ee-47a4-bde7-b5e8c44e757d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:46.661793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8a00ad5-98ee-47a4-bde7-b5e8c44e757d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:46.662246 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b8a00ad5-98ee-47a4-bde7-b5e8c44e757d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:46.675743 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5aab64bb-0e20-44c2-bbf9-41cb2629c582 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.102939 Oct 28 08:48:46.677380 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 523/1099] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:46 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:46.755693 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b8a00ad5-98ee-47a4-bde7-b5e8c44e757d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28206 microversion: 2.1 time: 0.108192 Oct 28 08:48:46.757090 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 577/1100] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:46 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28206 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:47.688482 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-da4b5015-5dcb-4c7a-8b69-64a9f1448866 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:47.689476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-da4b5015-5dcb-4c7a-8b69-64a9f1448866 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:47.696332 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-da4b5015-5dcb-4c7a-8b69-64a9f1448866 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:47.696767 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-da4b5015-5dcb-4c7a-8b69-64a9f1448866 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:47.697532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-da4b5015-5dcb-4c7a-8b69-64a9f1448866 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:47.697996 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-da4b5015-5dcb-4c7a-8b69-64a9f1448866 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:47.771804 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d5912b81-4703-4a58-bcf3-bf4ddeada7ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:47.772871 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d5912b81-4703-4a58-bcf3-bf4ddeada7ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:47.778060 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-da4b5015-5dcb-4c7a-8b69-64a9f1448866 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.093444 Oct 28 08:48:47.778928 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 524/1101] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:47 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:47.780042 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5912b81-4703-4a58-bcf3-bf4ddeada7ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:47.780488 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5912b81-4703-4a58-bcf3-bf4ddeada7ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:47.781273 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5912b81-4703-4a58-bcf3-bf4ddeada7ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:47.781705 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5912b81-4703-4a58-bcf3-bf4ddeada7ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:47.869628 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d5912b81-4703-4a58-bcf3-bf4ddeada7ac tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.104992 Oct 28 08:48:47.870336 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 578/1102] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:47 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:48.792127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-22e7f217-f681-46e6-ba30-477f6fa1b7be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:48.793153 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-22e7f217-f681-46e6-ba30-477f6fa1b7be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:48.801276 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22e7f217-f681-46e6-ba30-477f6fa1b7be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:48.801717 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22e7f217-f681-46e6-ba30-477f6fa1b7be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:48.802528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22e7f217-f681-46e6-ba30-477f6fa1b7be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:48.802967 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22e7f217-f681-46e6-ba30-477f6fa1b7be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:48.882086 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-22e7f217-f681-46e6-ba30-477f6fa1b7be tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.093806 Oct 28 08:48:48.886037 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 525/1103] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:48 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:48.886276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c979dc6c-524c-4f9b-a377-5c4ee2adab6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:48.886276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c979dc6c-524c-4f9b-a377-5c4ee2adab6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:48.891238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c979dc6c-524c-4f9b-a377-5c4ee2adab6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:48.891687 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c979dc6c-524c-4f9b-a377-5c4ee2adab6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:48.892493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c979dc6c-524c-4f9b-a377-5c4ee2adab6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:48.892928 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c979dc6c-524c-4f9b-a377-5c4ee2adab6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:48.984463 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c979dc6c-524c-4f9b-a377-5c4ee2adab6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.105202 Oct 28 08:48:48.985306 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 579/1104] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:48 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:49.895835 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7c887dac-d510-412e-a976-4b7dc4e3c07b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:49.896874 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7c887dac-d510-412e-a976-4b7dc4e3c07b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:49.904218 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7c887dac-d510-412e-a976-4b7dc4e3c07b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:49.904659 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7c887dac-d510-412e-a976-4b7dc4e3c07b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:49.905445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7c887dac-d510-412e-a976-4b7dc4e3c07b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:49.905929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7c887dac-d510-412e-a976-4b7dc4e3c07b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:49.979129 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7c887dac-d510-412e-a976-4b7dc4e3c07b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.088608 Oct 28 08:48:49.979687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 526/1105] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:49 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:49.997032 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c99fa0aa-fee0-4375-a35d-a296440d15b1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:49.998110 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c99fa0aa-fee0-4375-a35d-a296440d15b1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:50.006194 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c99fa0aa-fee0-4375-a35d-a296440d15b1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:50.006641 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c99fa0aa-fee0-4375-a35d-a296440d15b1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:50.007439 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c99fa0aa-fee0-4375-a35d-a296440d15b1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:50.007894 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c99fa0aa-fee0-4375-a35d-a296440d15b1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:50.080089 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c99fa0aa-fee0-4375-a35d-a296440d15b1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.087080 Oct 28 08:48:50.080747 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 580/1106] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:49 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:50.992392 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9f604ccd-c3e6-4e62-8b42-8d2ff43a25c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:50.993380 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9f604ccd-c3e6-4e62-8b42-8d2ff43a25c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:51.000577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9f604ccd-c3e6-4e62-8b42-8d2ff43a25c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:51.001010 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9f604ccd-c3e6-4e62-8b42-8d2ff43a25c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:51.002448 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9f604ccd-c3e6-4e62-8b42-8d2ff43a25c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:51.002880 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9f604ccd-c3e6-4e62-8b42-8d2ff43a25c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:51.068965 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9f604ccd-c3e6-4e62-8b42-8d2ff43a25c2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.080504 Oct 28 08:48:51.069624 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 527/1107] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:50 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:51.093553 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-593bc2b6-517a-4404-bbe1-f39a0757afbb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:51.094590 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-593bc2b6-517a-4404-bbe1-f39a0757afbb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:51.101452 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-593bc2b6-517a-4404-bbe1-f39a0757afbb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:51.101944 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-593bc2b6-517a-4404-bbe1-f39a0757afbb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:51.102727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-593bc2b6-517a-4404-bbe1-f39a0757afbb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:51.103166 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-593bc2b6-517a-4404-bbe1-f39a0757afbb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:51.173056 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-593bc2b6-517a-4404-bbe1-f39a0757afbb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.083477 Oct 28 08:48:51.174350 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 581/1108] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:51 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:52.081242 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bd42a695-cb24-4dfb-8f05-da68f90f0110 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:52.082267 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bd42a695-cb24-4dfb-8f05-da68f90f0110 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:52.089069 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bd42a695-cb24-4dfb-8f05-da68f90f0110 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:52.089515 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bd42a695-cb24-4dfb-8f05-da68f90f0110 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:52.090322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bd42a695-cb24-4dfb-8f05-da68f90f0110 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:52.090760 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bd42a695-cb24-4dfb-8f05-da68f90f0110 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:52.162660 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bd42a695-cb24-4dfb-8f05-da68f90f0110 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.085817 Oct 28 08:48:52.163365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 528/1109] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:52 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:52.185732 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1077ed0a-abe5-4662-afae-d151de83589b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:52.186765 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1077ed0a-abe5-4662-afae-d151de83589b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:52.193894 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1077ed0a-abe5-4662-afae-d151de83589b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:52.194343 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1077ed0a-abe5-4662-afae-d151de83589b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:52.195122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1077ed0a-abe5-4662-afae-d151de83589b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:52.195557 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1077ed0a-abe5-4662-afae-d151de83589b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:52.261563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1077ed0a-abe5-4662-afae-d151de83589b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.079599 Oct 28 08:48:52.262277 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 582/1110] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:52 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:53.176105 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-65363df4-2ea0-4333-bfd9-486d808d07d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:53.177124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-65363df4-2ea0-4333-bfd9-486d808d07d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:53.183948 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65363df4-2ea0-4333-bfd9-486d808d07d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:53.184388 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65363df4-2ea0-4333-bfd9-486d808d07d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:53.185140 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65363df4-2ea0-4333-bfd9-486d808d07d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:53.185564 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-65363df4-2ea0-4333-bfd9-486d808d07d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:53.259399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-65363df4-2ea0-4333-bfd9-486d808d07d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.088331 Oct 28 08:48:53.260048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 529/1111] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:53 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:53.273989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a95306c0-0e3a-4e99-80f8-ea4431eae3b7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:53.274992 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a95306c0-0e3a-4e99-80f8-ea4431eae3b7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:53.281748 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a95306c0-0e3a-4e99-80f8-ea4431eae3b7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:53.282225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a95306c0-0e3a-4e99-80f8-ea4431eae3b7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:53.283684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a95306c0-0e3a-4e99-80f8-ea4431eae3b7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:53.284120 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a95306c0-0e3a-4e99-80f8-ea4431eae3b7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:53.347190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a95306c0-0e3a-4e99-80f8-ea4431eae3b7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.077065 Oct 28 08:48:53.348031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 583/1112] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:53 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:54.272034 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4a4beeed-10d2-4e44-8753-69a5aa2650d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:54.273035 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4a4beeed-10d2-4e44-8753-69a5aa2650d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:54.279972 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a4beeed-10d2-4e44-8753-69a5aa2650d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:54.280411 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a4beeed-10d2-4e44-8753-69a5aa2650d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:54.281175 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a4beeed-10d2-4e44-8753-69a5aa2650d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:54.281611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a4beeed-10d2-4e44-8753-69a5aa2650d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:54.357949 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4a4beeed-10d2-4e44-8753-69a5aa2650d3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.089335 Oct 28 08:48:54.359139 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 530/1113] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:54 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:54.363952 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b7797050-a0a3-4b1c-8459-05db87fb98c9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:54.365516 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b7797050-a0a3-4b1c-8459-05db87fb98c9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:54.372885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b7797050-a0a3-4b1c-8459-05db87fb98c9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:54.373333 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b7797050-a0a3-4b1c-8459-05db87fb98c9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:54.374151 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b7797050-a0a3-4b1c-8459-05db87fb98c9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:54.374595 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b7797050-a0a3-4b1c-8459-05db87fb98c9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:54.448869 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b7797050-a0a3-4b1c-8459-05db87fb98c9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.092513 Oct 28 08:48:54.450576 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 584/1114] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:54 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:55.371245 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-34d8ca9e-4df8-42fe-bcfe-cc19eaad2f34 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:55.372261 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-34d8ca9e-4df8-42fe-bcfe-cc19eaad2f34 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:55.379823 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-34d8ca9e-4df8-42fe-bcfe-cc19eaad2f34 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:55.380255 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-34d8ca9e-4df8-42fe-bcfe-cc19eaad2f34 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:55.381015 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-34d8ca9e-4df8-42fe-bcfe-cc19eaad2f34 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:55.381436 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-34d8ca9e-4df8-42fe-bcfe-cc19eaad2f34 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:55.458903 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-34d8ca9e-4df8-42fe-bcfe-cc19eaad2f34 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.091466 Oct 28 08:48:55.463203 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 531/1115] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:55 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:55.463419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d0f047e4-1fa4-4a82-8c6e-e1e57ea74ed2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:55.463419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d0f047e4-1fa4-4a82-8c6e-e1e57ea74ed2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:55.471004 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d0f047e4-1fa4-4a82-8c6e-e1e57ea74ed2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:55.471004 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d0f047e4-1fa4-4a82-8c6e-e1e57ea74ed2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:55.472150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d0f047e4-1fa4-4a82-8c6e-e1e57ea74ed2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:55.473533 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d0f047e4-1fa4-4a82-8c6e-e1e57ea74ed2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:55.548400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d0f047e4-1fa4-4a82-8c6e-e1e57ea74ed2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.090748 Oct 28 08:48:55.549378 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 585/1116] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:55 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:56.471943 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ecfda7b7-0d0d-4240-9424-9cb4f938d66d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:56.472843 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ecfda7b7-0d0d-4240-9424-9cb4f938d66d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:56.479749 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ecfda7b7-0d0d-4240-9424-9cb4f938d66d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:56.480181 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ecfda7b7-0d0d-4240-9424-9cb4f938d66d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:56.480961 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ecfda7b7-0d0d-4240-9424-9cb4f938d66d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:56.481385 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ecfda7b7-0d0d-4240-9424-9cb4f938d66d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:56.556409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ecfda7b7-0d0d-4240-9424-9cb4f938d66d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.088883 Oct 28 08:48:56.557071 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 532/1117] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:56 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:56.563655 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a1f55225-1b4e-47b5-8b64-66aa299f4d77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:56.565497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a1f55225-1b4e-47b5-8b64-66aa299f4d77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:56.574400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a1f55225-1b4e-47b5-8b64-66aa299f4d77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:56.574853 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a1f55225-1b4e-47b5-8b64-66aa299f4d77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:56.575649 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a1f55225-1b4e-47b5-8b64-66aa299f4d77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:56.576082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a1f55225-1b4e-47b5-8b64-66aa299f4d77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:56.640640 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a1f55225-1b4e-47b5-8b64-66aa299f4d77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.083117 Oct 28 08:48:56.641329 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 586/1118] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:56 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:57.578541 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a618766e-7d3e-4280-979a-ef2d41504aa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:57.579628 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a618766e-7d3e-4280-979a-ef2d41504aa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:57.586721 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a618766e-7d3e-4280-979a-ef2d41504aa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:57.587168 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a618766e-7d3e-4280-979a-ef2d41504aa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:57.587981 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a618766e-7d3e-4280-979a-ef2d41504aa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:57.588413 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a618766e-7d3e-4280-979a-ef2d41504aa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:57.652958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a618766e-7d3e-4280-979a-ef2d41504aa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.085921 Oct 28 08:48:57.653855 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 533/1119] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:57 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:57.654027 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1a519adc-9a90-422f-958c-1f7daa468697 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:57.654958 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1a519adc-9a90-422f-958c-1f7daa468697 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:57.662814 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1a519adc-9a90-422f-958c-1f7daa468697 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:57.663264 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1a519adc-9a90-422f-958c-1f7daa468697 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:57.664055 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1a519adc-9a90-422f-958c-1f7daa468697 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:57.664498 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1a519adc-9a90-422f-958c-1f7daa468697 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:57.726642 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1a519adc-9a90-422f-958c-1f7daa468697 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.076508 Oct 28 08:48:57.727271 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 587/1120] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:57 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:58.666136 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-480544f1-f2fc-40f9-b647-4e31885fd968 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:58.667161 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-480544f1-f2fc-40f9-b647-4e31885fd968 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:58.674833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-480544f1-f2fc-40f9-b647-4e31885fd968 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:58.675283 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-480544f1-f2fc-40f9-b647-4e31885fd968 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:58.676070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-480544f1-f2fc-40f9-b647-4e31885fd968 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:58.676504 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-480544f1-f2fc-40f9-b647-4e31885fd968 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:58.738805 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0c0335e7-4019-42de-a094-7f60c3b51ad6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:58.739716 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0c0335e7-4019-42de-a094-7f60c3b51ad6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:58.744854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-480544f1-f2fc-40f9-b647-4e31885fd968 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.082947 Oct 28 08:48:58.745596 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 534/1121] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:58 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:58.747055 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c0335e7-4019-42de-a094-7f60c3b51ad6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:58.747496 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c0335e7-4019-42de-a094-7f60c3b51ad6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:58.748267 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c0335e7-4019-42de-a094-7f60c3b51ad6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:58.748694 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c0335e7-4019-42de-a094-7f60c3b51ad6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:58.813069 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0c0335e7-4019-42de-a094-7f60c3b51ad6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.078310 Oct 28 08:48:58.813743 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 588/1122] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:58 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:59.757595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-17c537f1-889a-4af7-b0ab-d8ee30fb0db5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:59.758627 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-17c537f1-889a-4af7-b0ab-d8ee30fb0db5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:59.769555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-17c537f1-889a-4af7-b0ab-d8ee30fb0db5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:59.770042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-17c537f1-889a-4af7-b0ab-d8ee30fb0db5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:59.770825 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-17c537f1-889a-4af7-b0ab-d8ee30fb0db5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:59.771262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-17c537f1-889a-4af7-b0ab-d8ee30fb0db5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:59.825518 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e730be0b-23aa-4d5a-b93d-1f309c34344b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:59.826654 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e730be0b-23aa-4d5a-b93d-1f309c34344b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:59.834323 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e730be0b-23aa-4d5a-b93d-1f309c34344b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:59.834774 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e730be0b-23aa-4d5a-b93d-1f309c34344b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:59.835672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e730be0b-23aa-4d5a-b93d-1f309c34344b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:59.836104 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e730be0b-23aa-4d5a-b93d-1f309c34344b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:59.839558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-17c537f1-889a-4af7-b0ab-d8ee30fb0db5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.085883 Oct 28 08:48:59.843678 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 535/1123] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:59 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:59.900587 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e730be0b-23aa-4d5a-b93d-1f309c34344b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.079062 Oct 28 08:48:59.901240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 589/1124] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:59 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:00.852503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9d968f2a-e274-41d5-8147-8fcb3f6208f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:00.853503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9d968f2a-e274-41d5-8147-8fcb3f6208f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:00.860857 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d968f2a-e274-41d5-8147-8fcb3f6208f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:00.862018 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d968f2a-e274-41d5-8147-8fcb3f6208f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:00.862827 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d968f2a-e274-41d5-8147-8fcb3f6208f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:00.863306 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d968f2a-e274-41d5-8147-8fcb3f6208f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:00.915457 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7acc090e-dfd9-4a35-9558-0cc0308064e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:00.917005 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7acc090e-dfd9-4a35-9558-0cc0308064e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:00.926180 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7acc090e-dfd9-4a35-9558-0cc0308064e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:00.926636 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7acc090e-dfd9-4a35-9558-0cc0308064e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:00.927630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7acc090e-dfd9-4a35-9558-0cc0308064e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:00.928083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7acc090e-dfd9-4a35-9558-0cc0308064e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:00.929756 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9d968f2a-e274-41d5-8147-8fcb3f6208f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.081218 Oct 28 08:49:00.930695 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 536/1125] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:00 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:00.996525 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7acc090e-dfd9-4a35-9558-0cc0308064e9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.086930 Oct 28 08:49:00.997138 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 590/1126] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:00 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:01.942121 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a8dfec2b-b2e3-413a-94d5-c872d9bbeb8e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:01.943030 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a8dfec2b-b2e3-413a-94d5-c872d9bbeb8e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:01.950196 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a8dfec2b-b2e3-413a-94d5-c872d9bbeb8e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:01.950647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a8dfec2b-b2e3-413a-94d5-c872d9bbeb8e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:01.951415 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a8dfec2b-b2e3-413a-94d5-c872d9bbeb8e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:01.951851 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a8dfec2b-b2e3-413a-94d5-c872d9bbeb8e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:02.007779 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7b1fbeab-328c-4950-b3b6-372c2513ba0a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:02.008820 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7b1fbeab-328c-4950-b3b6-372c2513ba0a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:02.015796 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7b1fbeab-328c-4950-b3b6-372c2513ba0a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:02.016237 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7b1fbeab-328c-4950-b3b6-372c2513ba0a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:02.017050 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7b1fbeab-328c-4950-b3b6-372c2513ba0a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:02.017493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7b1fbeab-328c-4950-b3b6-372c2513ba0a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:02.025886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a8dfec2b-b2e3-413a-94d5-c872d9bbeb8e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.087723 Oct 28 08:49:02.029822 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 537/1127] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:01 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:02.082715 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7b1fbeab-328c-4950-b3b6-372c2513ba0a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.078920 Oct 28 08:49:02.083349 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 591/1128] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:02 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:03.038617 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d82bcfac-07ac-47d1-aec9-3347a322de1c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:03.039605 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d82bcfac-07ac-47d1-aec9-3347a322de1c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:03.046496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d82bcfac-07ac-47d1-aec9-3347a322de1c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:03.046938 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d82bcfac-07ac-47d1-aec9-3347a322de1c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:03.047707 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d82bcfac-07ac-47d1-aec9-3347a322de1c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:03.048134 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d82bcfac-07ac-47d1-aec9-3347a322de1c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:03.095443 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-de7b489e-638b-4212-a271-78a38a77f4c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:03.096453 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-de7b489e-638b-4212-a271-78a38a77f4c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:03.103373 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de7b489e-638b-4212-a271-78a38a77f4c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:03.103825 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de7b489e-638b-4212-a271-78a38a77f4c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:03.104623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de7b489e-638b-4212-a271-78a38a77f4c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:03.105034 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de7b489e-638b-4212-a271-78a38a77f4c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:03.119318 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d82bcfac-07ac-47d1-aec9-3347a322de1c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.084869 Oct 28 08:49:03.120267 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 538/1129] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:03 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:03.168361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-de7b489e-638b-4212-a271-78a38a77f4c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.076943 Oct 28 08:49:03.169033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 592/1130] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:03 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:04.132546 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fa50d1c5-269d-4a7b-8619-9a8b9e858ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:04.133572 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fa50d1c5-269d-4a7b-8619-9a8b9e858ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:04.140718 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa50d1c5-269d-4a7b-8619-9a8b9e858ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:04.141165 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa50d1c5-269d-4a7b-8619-9a8b9e858ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:04.141978 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa50d1c5-269d-4a7b-8619-9a8b9e858ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:04.143076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa50d1c5-269d-4a7b-8619-9a8b9e858ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:04.180132 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-698bcd99-8b34-4d95-b4ee-3b1a13e38d6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:04.181146 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-698bcd99-8b34-4d95-b4ee-3b1a13e38d6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:04.188419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-698bcd99-8b34-4d95-b4ee-3b1a13e38d6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:04.188858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-698bcd99-8b34-4d95-b4ee-3b1a13e38d6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:04.190172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-698bcd99-8b34-4d95-b4ee-3b1a13e38d6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:04.190597 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-698bcd99-8b34-4d95-b4ee-3b1a13e38d6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:04.204197 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fa50d1c5-269d-4a7b-8619-9a8b9e858ea3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28202 microversion: 2.20 time: 0.075735 Oct 28 08:49:04.205515 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 539/1131] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:04 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:04.254104 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-698bcd99-8b34-4d95-b4ee-3b1a13e38d6c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28323 microversion: 2.1 time: 0.077924 Oct 28 08:49:04.254774 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 593/1132] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:04 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28323 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:05.217294 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d70f3d44-d4e5-4619-91f3-8d8946b81d82 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:05.218233 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d70f3d44-d4e5-4619-91f3-8d8946b81d82 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:05.226788 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d70f3d44-d4e5-4619-91f3-8d8946b81d82 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:05.227230 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d70f3d44-d4e5-4619-91f3-8d8946b81d82 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:05.228012 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d70f3d44-d4e5-4619-91f3-8d8946b81d82 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:05.228448 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d70f3d44-d4e5-4619-91f3-8d8946b81d82 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:05.266876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-051595db-71af-42d6-bd2f-b672b04f543e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:05.268020 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-051595db-71af-42d6-bd2f-b672b04f543e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:05.275177 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-051595db-71af-42d6-bd2f-b672b04f543e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:05.275644 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-051595db-71af-42d6-bd2f-b672b04f543e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:05.276459 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-051595db-71af-42d6-bd2f-b672b04f543e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:05.276885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-051595db-71af-42d6-bd2f-b672b04f543e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:05.309360 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d70f3d44-d4e5-4619-91f3-8d8946b81d82 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28493 microversion: 2.20 time: 0.096181 Oct 28 08:49:05.310036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 540/1133] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:05 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28493 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:05.374579 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-051595db-71af-42d6-bd2f-b672b04f543e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28614 microversion: 2.1 time: 0.111547 Oct 28 08:49:05.375246 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 594/1134] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:05 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:06.322199 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-92f781e5-e464-4273-9c67-5e45fa53426e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:06.323221 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-92f781e5-e464-4273-9c67-5e45fa53426e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:06.331197 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92f781e5-e464-4273-9c67-5e45fa53426e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:06.331654 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92f781e5-e464-4273-9c67-5e45fa53426e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:06.332497 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92f781e5-e464-4273-9c67-5e45fa53426e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:06.332939 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92f781e5-e464-4273-9c67-5e45fa53426e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:06.389484 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d52ee50f-263c-4cca-8f3b-74ce6f3a9b4e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:06.390429 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d52ee50f-263c-4cca-8f3b-74ce6f3a9b4e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:06.397533 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d52ee50f-263c-4cca-8f3b-74ce6f3a9b4e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:06.398015 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d52ee50f-263c-4cca-8f3b-74ce6f3a9b4e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:06.398904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d52ee50f-263c-4cca-8f3b-74ce6f3a9b4e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:06.399345 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d52ee50f-263c-4cca-8f3b-74ce6f3a9b4e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:06.403019 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-92f781e5-e464-4273-9c67-5e45fa53426e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28493 microversion: 2.20 time: 0.084918 Oct 28 08:49:06.403872 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 541/1135] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:06 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28493 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:06.467057 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d52ee50f-263c-4cca-8f3b-74ce6f3a9b4e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28614 microversion: 2.1 time: 0.081502 Oct 28 08:49:06.467723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 595/1136] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:06 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:07.415659 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-79b83d7f-148d-4668-b242-9b555224314f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:07.416817 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-79b83d7f-148d-4668-b242-9b555224314f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:07.424285 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-79b83d7f-148d-4668-b242-9b555224314f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:07.424741 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-79b83d7f-148d-4668-b242-9b555224314f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:07.425534 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-79b83d7f-148d-4668-b242-9b555224314f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:07.425994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-79b83d7f-148d-4668-b242-9b555224314f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:07.479874 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-af12743d-476e-4286-8847-acc085d2ffc9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:07.480904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-af12743d-476e-4286-8847-acc085d2ffc9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:07.488709 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-af12743d-476e-4286-8847-acc085d2ffc9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:07.489144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-af12743d-476e-4286-8847-acc085d2ffc9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:07.489946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-af12743d-476e-4286-8847-acc085d2ffc9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:07.490373 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-af12743d-476e-4286-8847-acc085d2ffc9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:07.501194 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-79b83d7f-148d-4668-b242-9b555224314f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.089446 Oct 28 08:49:07.502887 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 542/1137] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:07 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:07.574598 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-af12743d-476e-4286-8847-acc085d2ffc9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.098590 Oct 28 08:49:07.575572 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 596/1138] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:07 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:08.518410 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a5f78814-c151-4e72-8d66-20579868f643 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:08.519369 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a5f78814-c151-4e72-8d66-20579868f643 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:08.526886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a5f78814-c151-4e72-8d66-20579868f643 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:08.527396 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a5f78814-c151-4e72-8d66-20579868f643 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:08.528127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a5f78814-c151-4e72-8d66-20579868f643 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:08.528550 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a5f78814-c151-4e72-8d66-20579868f643 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:08.586712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e42294e2-108f-488e-97ab-2a6afd9e07b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:08.587718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e42294e2-108f-488e-97ab-2a6afd9e07b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:08.594895 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e42294e2-108f-488e-97ab-2a6afd9e07b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:08.595950 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e42294e2-108f-488e-97ab-2a6afd9e07b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:08.596724 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e42294e2-108f-488e-97ab-2a6afd9e07b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:08.597162 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e42294e2-108f-488e-97ab-2a6afd9e07b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:08.599431 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a5f78814-c151-4e72-8d66-20579868f643 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.085350 Oct 28 08:49:08.600430 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 543/1139] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:08 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:08.657372 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e42294e2-108f-488e-97ab-2a6afd9e07b8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.074575 Oct 28 08:49:08.658621 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 597/1140] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:08 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:09.611874 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5b132d49-d3eb-46ec-a0e4-9a2eaf8bc2d5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:09.612867 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5b132d49-d3eb-46ec-a0e4-9a2eaf8bc2d5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:09.622633 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5b132d49-d3eb-46ec-a0e4-9a2eaf8bc2d5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:09.623321 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5b132d49-d3eb-46ec-a0e4-9a2eaf8bc2d5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:09.624617 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5b132d49-d3eb-46ec-a0e4-9a2eaf8bc2d5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:09.625072 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5b132d49-d3eb-46ec-a0e4-9a2eaf8bc2d5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:09.674905 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b1082c94-d92f-47af-855c-89e0784c0857 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:09.675568 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b1082c94-d92f-47af-855c-89e0784c0857 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:09.682713 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b1082c94-d92f-47af-855c-89e0784c0857 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:09.683165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b1082c94-d92f-47af-855c-89e0784c0857 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:09.683958 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b1082c94-d92f-47af-855c-89e0784c0857 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:09.684395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b1082c94-d92f-47af-855c-89e0784c0857 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:09.694542 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5b132d49-d3eb-46ec-a0e4-9a2eaf8bc2d5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.086583 Oct 28 08:49:09.695246 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 544/1141] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:09 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:09.756640 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b1082c94-d92f-47af-855c-89e0784c0857 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.089761 Oct 28 08:49:09.757315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 598/1142] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:09 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:10.707901 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f356d930-16c8-4620-9f8f-34783cc0e170 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:10.709019 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f356d930-16c8-4620-9f8f-34783cc0e170 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:10.716625 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f356d930-16c8-4620-9f8f-34783cc0e170 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:10.717096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f356d930-16c8-4620-9f8f-34783cc0e170 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:10.717957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f356d930-16c8-4620-9f8f-34783cc0e170 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:10.718390 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f356d930-16c8-4620-9f8f-34783cc0e170 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:10.769761 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-40a5f362-c0e3-48ec-972f-ac6794ac5b43 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:10.770592 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-40a5f362-c0e3-48ec-972f-ac6794ac5b43 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:10.777402 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-40a5f362-c0e3-48ec-972f-ac6794ac5b43 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:10.777900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-40a5f362-c0e3-48ec-972f-ac6794ac5b43 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:10.778669 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-40a5f362-c0e3-48ec-972f-ac6794ac5b43 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:10.779099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-40a5f362-c0e3-48ec-972f-ac6794ac5b43 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:10.793743 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f356d930-16c8-4620-9f8f-34783cc0e170 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.090827 Oct 28 08:49:10.797917 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 545/1143] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:10 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:10.840950 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-40a5f362-c0e3-48ec-972f-ac6794ac5b43 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.076051 Oct 28 08:49:10.841678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 599/1144] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:10 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:11.807181 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e3faa8d9-6329-4d40-ae66-505142a7882e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:11.808337 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e3faa8d9-6329-4d40-ae66-505142a7882e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:11.815806 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3faa8d9-6329-4d40-ae66-505142a7882e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:11.816252 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3faa8d9-6329-4d40-ae66-505142a7882e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:11.817376 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3faa8d9-6329-4d40-ae66-505142a7882e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:11.817914 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3faa8d9-6329-4d40-ae66-505142a7882e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:11.854074 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0c42b59c-6018-4301-93e8-453d9d59276b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:11.855080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0c42b59c-6018-4301-93e8-453d9d59276b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:11.861909 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c42b59c-6018-4301-93e8-453d9d59276b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:11.862357 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c42b59c-6018-4301-93e8-453d9d59276b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:11.871559 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c42b59c-6018-4301-93e8-453d9d59276b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:11.872009 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0c42b59c-6018-4301-93e8-453d9d59276b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:11.893355 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e3faa8d9-6329-4d40-ae66-505142a7882e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.091007 Oct 28 08:49:11.894049 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 546/1145] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:11 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:11.943016 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0c42b59c-6018-4301-93e8-453d9d59276b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.092768 Oct 28 08:49:11.943696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 600/1146] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:11 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:12.906956 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-75d159a1-9f7b-4f4a-89f4-5efaacb38d53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:12.908024 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-75d159a1-9f7b-4f4a-89f4-5efaacb38d53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:12.916002 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-75d159a1-9f7b-4f4a-89f4-5efaacb38d53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:12.916445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-75d159a1-9f7b-4f4a-89f4-5efaacb38d53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:12.917226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-75d159a1-9f7b-4f4a-89f4-5efaacb38d53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:12.917678 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-75d159a1-9f7b-4f4a-89f4-5efaacb38d53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:12.955456 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9f2e5764-758e-4c01-bf30-bede80455c64 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:12.956432 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9f2e5764-758e-4c01-bf30-bede80455c64 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:12.963865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f2e5764-758e-4c01-bf30-bede80455c64 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:12.964360 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f2e5764-758e-4c01-bf30-bede80455c64 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:12.965076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f2e5764-758e-4c01-bf30-bede80455c64 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:12.965501 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f2e5764-758e-4c01-bf30-bede80455c64 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:12.981411 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-75d159a1-9f7b-4f4a-89f4-5efaacb38d53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.078460 Oct 28 08:49:12.982341 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 547/1147] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:12 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:13.029858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9f2e5764-758e-4c01-bf30-bede80455c64 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.078330 Oct 28 08:49:13.030530 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 601/1148] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:12 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:13.995156 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b8ecd5d7-dbb1-4fe4-85f2-9584833affa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:13.996191 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b8ecd5d7-dbb1-4fe4-85f2-9584833affa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:14.003490 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b8ecd5d7-dbb1-4fe4-85f2-9584833affa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:14.003932 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b8ecd5d7-dbb1-4fe4-85f2-9584833affa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:14.005371 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b8ecd5d7-dbb1-4fe4-85f2-9584833affa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:14.005832 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b8ecd5d7-dbb1-4fe4-85f2-9584833affa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:14.042844 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-81c44a23-5ce5-4a2c-8ff7-d4497baff9a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:14.043880 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-81c44a23-5ce5-4a2c-8ff7-d4497baff9a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:14.051831 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-81c44a23-5ce5-4a2c-8ff7-d4497baff9a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:14.052298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-81c44a23-5ce5-4a2c-8ff7-d4497baff9a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:14.053109 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-81c44a23-5ce5-4a2c-8ff7-d4497baff9a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:14.053550 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-81c44a23-5ce5-4a2c-8ff7-d4497baff9a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:14.072169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b8ecd5d7-dbb1-4fe4-85f2-9584833affa6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.081115 Oct 28 08:49:14.073041 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 548/1149] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:13 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:14.116778 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-81c44a23-5ce5-4a2c-8ff7-d4497baff9a8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.077758 Oct 28 08:49:14.117473 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 602/1150] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:14 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:15.086710 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-92314334-fac6-485b-a9bd-d26582204389 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:15.087874 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-92314334-fac6-485b-a9bd-d26582204389 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:15.095354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92314334-fac6-485b-a9bd-d26582204389 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:15.095796 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92314334-fac6-485b-a9bd-d26582204389 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:15.096578 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92314334-fac6-485b-a9bd-d26582204389 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:15.097011 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-92314334-fac6-485b-a9bd-d26582204389 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:15.131558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-426d4660-a000-43f5-be72-f05e5cf7c211 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:15.132771 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-426d4660-a000-43f5-be72-f05e5cf7c211 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:15.139840 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-426d4660-a000-43f5-be72-f05e5cf7c211 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:15.140296 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-426d4660-a000-43f5-be72-f05e5cf7c211 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:15.141101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-426d4660-a000-43f5-be72-f05e5cf7c211 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:15.141534 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-426d4660-a000-43f5-be72-f05e5cf7c211 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:15.167894 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-92314334-fac6-485b-a9bd-d26582204389 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.086655 Oct 28 08:49:15.170623 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 549/1151] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:15 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:15.207132 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-426d4660-a000-43f5-be72-f05e5cf7c211 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.081030 Oct 28 08:49:15.208003 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 603/1152] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:15 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:16.180682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f459216f-219a-4af0-8e13-292782a7680b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:16.188183 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f459216f-219a-4af0-8e13-292782a7680b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:16.196258 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f459216f-219a-4af0-8e13-292782a7680b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:16.196731 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f459216f-219a-4af0-8e13-292782a7680b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:16.197620 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f459216f-219a-4af0-8e13-292782a7680b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:16.198131 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f459216f-219a-4af0-8e13-292782a7680b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:16.220022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6422148b-c113-4fac-b675-b6b6249fc9f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:16.221048 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6422148b-c113-4fac-b675-b6b6249fc9f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:16.229955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6422148b-c113-4fac-b675-b6b6249fc9f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:16.230435 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6422148b-c113-4fac-b675-b6b6249fc9f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:16.231254 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6422148b-c113-4fac-b675-b6b6249fc9f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:16.231688 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6422148b-c113-4fac-b675-b6b6249fc9f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:16.298043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6422148b-c113-4fac-b675-b6b6249fc9f0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.081993 Oct 28 08:49:16.299072 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 604/1153] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:16 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:16.420418 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f459216f-219a-4af0-8e13-292782a7680b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.243743 Oct 28 08:49:16.421007 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 550/1154] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:16 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:17.310662 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e0d8b675-146c-44b2-9322-165bed0e71e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:17.311681 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e0d8b675-146c-44b2-9322-165bed0e71e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:17.318789 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e0d8b675-146c-44b2-9322-165bed0e71e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:17.319239 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e0d8b675-146c-44b2-9322-165bed0e71e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:17.320020 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e0d8b675-146c-44b2-9322-165bed0e71e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:17.320453 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e0d8b675-146c-44b2-9322-165bed0e71e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:17.387125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e0d8b675-146c-44b2-9322-165bed0e71e8 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.080385 Oct 28 08:49:17.387827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 605/1155] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:17 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:17.432766 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3c2df467-4f80-48dd-97e2-d5d7a97f2573 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:17.433770 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3c2df467-4f80-48dd-97e2-d5d7a97f2573 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:17.441315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c2df467-4f80-48dd-97e2-d5d7a97f2573 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:17.441760 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c2df467-4f80-48dd-97e2-d5d7a97f2573 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:17.442584 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c2df467-4f80-48dd-97e2-d5d7a97f2573 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:17.443016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3c2df467-4f80-48dd-97e2-d5d7a97f2573 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:17.505700 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3c2df467-4f80-48dd-97e2-d5d7a97f2573 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.076808 Oct 28 08:49:17.506390 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 551/1156] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:17 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:18.399150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2af69448-5ddd-40e5-a792-d58a3a3a9949 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:18.400029 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2af69448-5ddd-40e5-a792-d58a3a3a9949 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:18.406941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2af69448-5ddd-40e5-a792-d58a3a3a9949 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:18.407381 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2af69448-5ddd-40e5-a792-d58a3a3a9949 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:18.408220 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2af69448-5ddd-40e5-a792-d58a3a3a9949 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:18.408925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2af69448-5ddd-40e5-a792-d58a3a3a9949 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:18.475672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2af69448-5ddd-40e5-a792-d58a3a3a9949 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.080805 Oct 28 08:49:18.476387 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 606/1157] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:18 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:18.518364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-202a68e5-ea2b-40c6-ae14-5f0f41fe338a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:18.519363 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-202a68e5-ea2b-40c6-ae14-5f0f41fe338a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:18.526964 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-202a68e5-ea2b-40c6-ae14-5f0f41fe338a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:18.527414 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-202a68e5-ea2b-40c6-ae14-5f0f41fe338a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:18.528334 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-202a68e5-ea2b-40c6-ae14-5f0f41fe338a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:18.528774 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-202a68e5-ea2b-40c6-ae14-5f0f41fe338a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:18.602140 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-202a68e5-ea2b-40c6-ae14-5f0f41fe338a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.087699 Oct 28 08:49:18.602845 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 552/1158] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:18 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:19.488315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1ecb42d0-20db-4a25-8931-f6897a2b0e62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:19.490268 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1ecb42d0-20db-4a25-8931-f6897a2b0e62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:19.497865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ecb42d0-20db-4a25-8931-f6897a2b0e62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:19.498314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ecb42d0-20db-4a25-8931-f6897a2b0e62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:19.499092 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ecb42d0-20db-4a25-8931-f6897a2b0e62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:19.499520 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ecb42d0-20db-4a25-8931-f6897a2b0e62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:19.563719 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1ecb42d0-20db-4a25-8931-f6897a2b0e62 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.079644 Oct 28 08:49:19.564630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 607/1159] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:19 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:19.615376 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3236fc03-7883-45f1-9e8f-9e65fb112bd7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:19.616377 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3236fc03-7883-45f1-9e8f-9e65fb112bd7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:19.623205 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3236fc03-7883-45f1-9e8f-9e65fb112bd7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:19.623647 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3236fc03-7883-45f1-9e8f-9e65fb112bd7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:19.624403 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3236fc03-7883-45f1-9e8f-9e65fb112bd7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:19.624833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3236fc03-7883-45f1-9e8f-9e65fb112bd7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:19.686610 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3236fc03-7883-45f1-9e8f-9e65fb112bd7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.075452 Oct 28 08:49:19.687074 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 553/1160] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:19 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:20.577801 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bd710ea3-a99b-456e-afdd-b8d8421da78b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:20.578806 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bd710ea3-a99b-456e-afdd-b8d8421da78b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:20.594105 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bd710ea3-a99b-456e-afdd-b8d8421da78b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:20.594554 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bd710ea3-a99b-456e-afdd-b8d8421da78b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:20.595337 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bd710ea3-a99b-456e-afdd-b8d8421da78b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:20.595773 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bd710ea3-a99b-456e-afdd-b8d8421da78b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:20.656386 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bd710ea3-a99b-456e-afdd-b8d8421da78b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.082550 Oct 28 08:49:20.657059 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 608/1161] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:20 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:20.699717 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-07b49255-734f-4089-a541-81fe139840b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:20.700823 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-07b49255-734f-4089-a541-81fe139840b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:20.709044 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-07b49255-734f-4089-a541-81fe139840b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:20.709578 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-07b49255-734f-4089-a541-81fe139840b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:20.710462 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-07b49255-734f-4089-a541-81fe139840b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:20.710958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-07b49255-734f-4089-a541-81fe139840b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:20.773153 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-07b49255-734f-4089-a541-81fe139840b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.077488 Oct 28 08:49:20.774158 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 554/1162] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:20 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:21.668797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e38a9554-2a6b-4979-bff3-d684a99b17f4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:21.669975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e38a9554-2a6b-4979-bff3-d684a99b17f4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:21.677209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e38a9554-2a6b-4979-bff3-d684a99b17f4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:21.677678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e38a9554-2a6b-4979-bff3-d684a99b17f4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:21.678478 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e38a9554-2a6b-4979-bff3-d684a99b17f4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:21.678916 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e38a9554-2a6b-4979-bff3-d684a99b17f4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:21.743961 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e38a9554-2a6b-4979-bff3-d684a99b17f4 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.079102 Oct 28 08:49:21.744545 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 609/1163] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:21 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:21.785231 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9cd2fa42-ef54-44a7-a61b-4ede9f5f686b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:21.793080 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9cd2fa42-ef54-44a7-a61b-4ede9f5f686b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:21.800058 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9cd2fa42-ef54-44a7-a61b-4ede9f5f686b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:21.800502 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9cd2fa42-ef54-44a7-a61b-4ede9f5f686b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:21.801558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9cd2fa42-ef54-44a7-a61b-4ede9f5f686b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:21.802317 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9cd2fa42-ef54-44a7-a61b-4ede9f5f686b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:21.873602 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9cd2fa42-ef54-44a7-a61b-4ede9f5f686b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.092484 Oct 28 08:49:21.874296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 555/1164] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:21 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:22.756996 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4c6afaaf-846b-4502-8688-700befcb7bd0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:22.758038 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4c6afaaf-846b-4502-8688-700befcb7bd0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:22.764973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c6afaaf-846b-4502-8688-700befcb7bd0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:22.765422 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c6afaaf-846b-4502-8688-700befcb7bd0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:22.766238 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c6afaaf-846b-4502-8688-700befcb7bd0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:22.766672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c6afaaf-846b-4502-8688-700befcb7bd0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:22.838670 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4c6afaaf-846b-4502-8688-700befcb7bd0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.086305 Oct 28 08:49:22.839360 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 610/1165] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:22 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:22.886365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6d2da4b1-c7a1-4729-a747-638a3664b534 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:22.887949 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6d2da4b1-c7a1-4729-a747-638a3664b534 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:22.895535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6d2da4b1-c7a1-4729-a747-638a3664b534 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:22.896328 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6d2da4b1-c7a1-4729-a747-638a3664b534 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:22.896818 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6d2da4b1-c7a1-4729-a747-638a3664b534 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:22.897247 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6d2da4b1-c7a1-4729-a747-638a3664b534 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:22.959122 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6d2da4b1-c7a1-4729-a747-638a3664b534 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.076792 Oct 28 08:49:22.959682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 556/1166] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:22 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:23.851623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8ca8833d-39fa-48c0-a05f-a80e63f0fc6b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:23.852539 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8ca8833d-39fa-48c0-a05f-a80e63f0fc6b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:23.859309 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8ca8833d-39fa-48c0-a05f-a80e63f0fc6b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:23.859747 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8ca8833d-39fa-48c0-a05f-a80e63f0fc6b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:23.860502 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8ca8833d-39fa-48c0-a05f-a80e63f0fc6b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:23.860929 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8ca8833d-39fa-48c0-a05f-a80e63f0fc6b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:23.936733 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8ca8833d-39fa-48c0-a05f-a80e63f0fc6b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.089502 Oct 28 08:49:23.937481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 611/1167] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:23 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:23.970681 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-aecb046d-0ecc-437b-9bcb-a20e1ad19220 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:23.976641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-aecb046d-0ecc-437b-9bcb-a20e1ad19220 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:23.979364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aecb046d-0ecc-437b-9bcb-a20e1ad19220 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:23.979802 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aecb046d-0ecc-437b-9bcb-a20e1ad19220 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:23.980576 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aecb046d-0ecc-437b-9bcb-a20e1ad19220 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:23.981003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aecb046d-0ecc-437b-9bcb-a20e1ad19220 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:24.056705 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-aecb046d-0ecc-437b-9bcb-a20e1ad19220 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.089831 Oct 28 08:49:24.057331 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 557/1168] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:23 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:24.949575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-adef69f0-31d0-4cd2-bd12-90fcfd000363 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:24.950605 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-adef69f0-31d0-4cd2-bd12-90fcfd000363 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:24.957369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-adef69f0-31d0-4cd2-bd12-90fcfd000363 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:24.957878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-adef69f0-31d0-4cd2-bd12-90fcfd000363 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:24.958637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-adef69f0-31d0-4cd2-bd12-90fcfd000363 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:24.959090 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-adef69f0-31d0-4cd2-bd12-90fcfd000363 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:25.022917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-adef69f0-31d0-4cd2-bd12-90fcfd000363 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.077258 Oct 28 08:49:25.023941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 612/1169] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:24 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:25.069060 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ee64b13f-b452-4021-82aa-45a9b703c032 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:25.070177 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ee64b13f-b452-4021-82aa-45a9b703c032 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:25.077720 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ee64b13f-b452-4021-82aa-45a9b703c032 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:25.078192 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ee64b13f-b452-4021-82aa-45a9b703c032 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:25.078971 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ee64b13f-b452-4021-82aa-45a9b703c032 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:25.079405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ee64b13f-b452-4021-82aa-45a9b703c032 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:25.171676 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ee64b13f-b452-4021-82aa-45a9b703c032 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.106691 Oct 28 08:49:25.172362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 558/1170] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:25 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:26.035694 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-62d6441c-2dc9-42d1-a115-4a91016b614f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:26.036955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-62d6441c-2dc9-42d1-a115-4a91016b614f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:26.043774 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-62d6441c-2dc9-42d1-a115-4a91016b614f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:26.044217 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-62d6441c-2dc9-42d1-a115-4a91016b614f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:26.044978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-62d6441c-2dc9-42d1-a115-4a91016b614f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:26.045407 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-62d6441c-2dc9-42d1-a115-4a91016b614f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:26.108697 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-62d6441c-2dc9-42d1-a115-4a91016b614f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.076975 Oct 28 08:49:26.109351 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 613/1171] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:26 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:26.185076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-45b1b75c-237f-4877-8d1b-a354e320b663 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:26.186148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-45b1b75c-237f-4877-8d1b-a354e320b663 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:26.194135 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45b1b75c-237f-4877-8d1b-a354e320b663 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:26.194572 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45b1b75c-237f-4877-8d1b-a354e320b663 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:26.195326 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45b1b75c-237f-4877-8d1b-a354e320b663 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:26.195751 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45b1b75c-237f-4877-8d1b-a354e320b663 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:26.258795 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-45b1b75c-237f-4877-8d1b-a354e320b663 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.078615 Oct 28 08:49:26.259475 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 559/1172] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:26 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:27.121178 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3f8d41ac-d5cb-463f-98a4-0299d4e4f376 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:27.122203 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3f8d41ac-d5cb-463f-98a4-0299d4e4f376 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:27.129021 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f8d41ac-d5cb-463f-98a4-0299d4e4f376 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:27.129536 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f8d41ac-d5cb-463f-98a4-0299d4e4f376 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:27.130325 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f8d41ac-d5cb-463f-98a4-0299d4e4f376 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:27.130758 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f8d41ac-d5cb-463f-98a4-0299d4e4f376 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:27.190614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3f8d41ac-d5cb-463f-98a4-0299d4e4f376 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.073334 Oct 28 08:49:27.191291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 614/1173] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:27 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:27.271625 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a1900cee-81a9-4968-aada-b9f37ed3eede tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:27.272627 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a1900cee-81a9-4968-aada-b9f37ed3eede tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:27.279802 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a1900cee-81a9-4968-aada-b9f37ed3eede tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:27.280249 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a1900cee-81a9-4968-aada-b9f37ed3eede tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:27.281023 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a1900cee-81a9-4968-aada-b9f37ed3eede tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:27.281454 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a1900cee-81a9-4968-aada-b9f37ed3eede tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:27.345457 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a1900cee-81a9-4968-aada-b9f37ed3eede tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.078623 Oct 28 08:49:27.346882 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 560/1174] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:27 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:28.203261 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-63be410a-679a-4e71-b84e-6db9000b6682 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:28.204272 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-63be410a-679a-4e71-b84e-6db9000b6682 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:28.212172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-63be410a-679a-4e71-b84e-6db9000b6682 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:28.212652 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-63be410a-679a-4e71-b84e-6db9000b6682 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:28.213434 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-63be410a-679a-4e71-b84e-6db9000b6682 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:28.213935 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-63be410a-679a-4e71-b84e-6db9000b6682 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:28.275374 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-63be410a-679a-4e71-b84e-6db9000b6682 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.076291 Oct 28 08:49:28.276048 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 615/1175] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:28 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:28.357929 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-20ac441b-488f-42fc-8960-456613144d45 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:28.358949 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-20ac441b-488f-42fc-8960-456613144d45 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:28.366814 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20ac441b-488f-42fc-8960-456613144d45 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:28.367193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20ac441b-488f-42fc-8960-456613144d45 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:28.367974 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20ac441b-488f-42fc-8960-456613144d45 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:28.368407 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-20ac441b-488f-42fc-8960-456613144d45 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:28.439977 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-20ac441b-488f-42fc-8960-456613144d45 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.086097 Oct 28 08:49:28.440637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 561/1176] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:28 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:29.289249 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0f56044c-9b01-4b4a-b464-42a5297e4a38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:29.290276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0f56044c-9b01-4b4a-b464-42a5297e4a38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:29.298098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f56044c-9b01-4b4a-b464-42a5297e4a38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:29.298534 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f56044c-9b01-4b4a-b464-42a5297e4a38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:29.299347 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f56044c-9b01-4b4a-b464-42a5297e4a38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:29.299773 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f56044c-9b01-4b4a-b464-42a5297e4a38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:29.364247 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0f56044c-9b01-4b4a-b464-42a5297e4a38 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.080474 Oct 28 08:49:29.364929 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 616/1177] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:29 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:29.452943 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3602b34c-c5ce-4781-8ce4-c6670aba3d0f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:29.453994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3602b34c-c5ce-4781-8ce4-c6670aba3d0f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:29.461983 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3602b34c-c5ce-4781-8ce4-c6670aba3d0f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:29.462424 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3602b34c-c5ce-4781-8ce4-c6670aba3d0f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:29.463183 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3602b34c-c5ce-4781-8ce4-c6670aba3d0f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:29.463611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3602b34c-c5ce-4781-8ce4-c6670aba3d0f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:29.527633 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3602b34c-c5ce-4781-8ce4-c6670aba3d0f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.078731 Oct 28 08:49:29.528528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 562/1178] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:29 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:30.376735 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c0760243-90ac-4159-9753-dc97f66a36d1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:30.377655 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c0760243-90ac-4159-9753-dc97f66a36d1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:30.392515 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c0760243-90ac-4159-9753-dc97f66a36d1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:30.392966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c0760243-90ac-4159-9753-dc97f66a36d1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:30.393760 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c0760243-90ac-4159-9753-dc97f66a36d1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:30.394221 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c0760243-90ac-4159-9753-dc97f66a36d1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:30.464532 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c0760243-90ac-4159-9753-dc97f66a36d1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.091776 Oct 28 08:49:30.465201 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 617/1179] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:30 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:30.540819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f58bc9aa-c907-4529-90c0-e8b56cb1be9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:30.541834 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f58bc9aa-c907-4529-90c0-e8b56cb1be9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:30.549544 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f58bc9aa-c907-4529-90c0-e8b56cb1be9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:30.550034 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f58bc9aa-c907-4529-90c0-e8b56cb1be9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:30.550831 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f58bc9aa-c907-4529-90c0-e8b56cb1be9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:30.551960 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f58bc9aa-c907-4529-90c0-e8b56cb1be9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:30.612641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f58bc9aa-c907-4529-90c0-e8b56cb1be9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.076705 Oct 28 08:49:30.613369 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 563/1180] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:30 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:31.476480 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3f89ac97-263f-41a6-b49f-6a82d9f83e67 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:31.477484 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3f89ac97-263f-41a6-b49f-6a82d9f83e67 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:31.485210 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f89ac97-263f-41a6-b49f-6a82d9f83e67 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:31.485657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f89ac97-263f-41a6-b49f-6a82d9f83e67 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:31.486542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f89ac97-263f-41a6-b49f-6a82d9f83e67 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:31.486977 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3f89ac97-263f-41a6-b49f-6a82d9f83e67 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:31.553513 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3f89ac97-263f-41a6-b49f-6a82d9f83e67 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.081267 Oct 28 08:49:31.554235 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 618/1181] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:31 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:31.625677 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bb50a88d-3f27-4621-af9b-08d9ff8bc1e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:31.626740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bb50a88d-3f27-4621-af9b-08d9ff8bc1e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:31.634185 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bb50a88d-3f27-4621-af9b-08d9ff8bc1e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:31.634633 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bb50a88d-3f27-4621-af9b-08d9ff8bc1e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:31.635598 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bb50a88d-3f27-4621-af9b-08d9ff8bc1e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:31.635903 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bb50a88d-3f27-4621-af9b-08d9ff8bc1e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:31.702411 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bb50a88d-3f27-4621-af9b-08d9ff8bc1e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.080640 Oct 28 08:49:31.703139 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 564/1182] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:31 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:32.565203 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-28d705e9-18f4-4a1b-ad67-bae717ff9ff7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:32.566242 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-28d705e9-18f4-4a1b-ad67-bae717ff9ff7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:32.581391 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28d705e9-18f4-4a1b-ad67-bae717ff9ff7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:32.581867 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28d705e9-18f4-4a1b-ad67-bae717ff9ff7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:32.583246 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28d705e9-18f4-4a1b-ad67-bae717ff9ff7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:32.583681 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-28d705e9-18f4-4a1b-ad67-bae717ff9ff7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:32.643980 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-28d705e9-18f4-4a1b-ad67-bae717ff9ff7 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.082699 Oct 28 08:49:32.644645 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 619/1183] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:32 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:32.715524 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0f43e41f-e06b-40ad-bb8f-5e4a42ecdd80 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:32.716532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0f43e41f-e06b-40ad-bb8f-5e4a42ecdd80 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:32.723816 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f43e41f-e06b-40ad-bb8f-5e4a42ecdd80 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:32.724270 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f43e41f-e06b-40ad-bb8f-5e4a42ecdd80 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:32.725064 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f43e41f-e06b-40ad-bb8f-5e4a42ecdd80 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:32.725505 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0f43e41f-e06b-40ad-bb8f-5e4a42ecdd80 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:32.788970 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0f43e41f-e06b-40ad-bb8f-5e4a42ecdd80 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.077352 Oct 28 08:49:32.789852 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 565/1184] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:32 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:33.656881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b3a8debb-ab3d-4576-b377-b81d5e6315ca tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:33.657903 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b3a8debb-ab3d-4576-b377-b81d5e6315ca tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:33.665827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b3a8debb-ab3d-4576-b377-b81d5e6315ca tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:33.666285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b3a8debb-ab3d-4576-b377-b81d5e6315ca tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:33.667069 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b3a8debb-ab3d-4576-b377-b81d5e6315ca tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:33.667501 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b3a8debb-ab3d-4576-b377-b81d5e6315ca tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:33.729630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b3a8debb-ab3d-4576-b377-b81d5e6315ca tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.076626 Oct 28 08:49:33.730330 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 620/1185] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:33 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:33.801168 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6db63884-fa9c-4a85-9394-5a0d02ea4305 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:33.802278 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6db63884-fa9c-4a85-9394-5a0d02ea4305 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:33.809163 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6db63884-fa9c-4a85-9394-5a0d02ea4305 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:33.809712 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6db63884-fa9c-4a85-9394-5a0d02ea4305 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:33.810421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6db63884-fa9c-4a85-9394-5a0d02ea4305 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:33.810852 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6db63884-fa9c-4a85-9394-5a0d02ea4305 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:33.887794 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6db63884-fa9c-4a85-9394-5a0d02ea4305 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.090560 Oct 28 08:49:33.888724 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 566/1186] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:33 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:34.742559 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-85de8cf5-97c1-4fc4-bee4-685d38473a53 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:34.743612 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-85de8cf5-97c1-4fc4-bee4-685d38473a53 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:34.750675 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-85de8cf5-97c1-4fc4-bee4-685d38473a53 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:34.751125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-85de8cf5-97c1-4fc4-bee4-685d38473a53 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:34.751902 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-85de8cf5-97c1-4fc4-bee4-685d38473a53 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:34.752336 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-85de8cf5-97c1-4fc4-bee4-685d38473a53 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:34.826433 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-85de8cf5-97c1-4fc4-bee4-685d38473a53 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.088314 Oct 28 08:49:34.827134 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 621/1187] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:34 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:34.900727 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8d21e840-9229-4623-90ed-590287ea2151 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:34.901730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8d21e840-9229-4623-90ed-590287ea2151 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:34.908683 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8d21e840-9229-4623-90ed-590287ea2151 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:34.909129 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8d21e840-9229-4623-90ed-590287ea2151 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:34.909933 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8d21e840-9229-4623-90ed-590287ea2151 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:34.910448 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8d21e840-9229-4623-90ed-590287ea2151 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:35.839698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-383551d1-e5c1-436b-b556-4f0af4369eba tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:35.840818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-383551d1-e5c1-436b-b556-4f0af4369eba tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:35.848274 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-383551d1-e5c1-436b-b556-4f0af4369eba tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:35.848743 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-383551d1-e5c1-436b-b556-4f0af4369eba tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:35.849502 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-383551d1-e5c1-436b-b556-4f0af4369eba tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:35.850073 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-383551d1-e5c1-436b-b556-4f0af4369eba tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:38.407286 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8d21e840-9229-4623-90ed-590287ea2151 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 3.510631 Oct 28 08:49:38.407848 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 567/1188] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:34 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 3513 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:38.421604 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-383551d1-e5c1-436b-b556-4f0af4369eba tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 2.585876 Oct 28 08:49:38.422293 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 622/1189] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:35 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:39.420663 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-2b975073-4d3e-4029-a067-d9fa50f10bf6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:39.421765 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-2b975073-4d3e-4029-a067-d9fa50f10bf6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:39.431220 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2b975073-4d3e-4029-a067-d9fa50f10bf6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:39.431661 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2b975073-4d3e-4029-a067-d9fa50f10bf6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:39.432425 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2b975073-4d3e-4029-a067-d9fa50f10bf6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:39.432852 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-2b975073-4d3e-4029-a067-d9fa50f10bf6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:39.434547 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-89831a5a-22a4-4661-8f0b-9c21d530dd0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:39.435540 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-89831a5a-22a4-4661-8f0b-9c21d530dd0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:39.443915 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89831a5a-22a4-4661-8f0b-9c21d530dd0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:39.444528 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89831a5a-22a4-4661-8f0b-9c21d530dd0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:39.445308 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89831a5a-22a4-4661-8f0b-9c21d530dd0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:39.445743 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-89831a5a-22a4-4661-8f0b-9c21d530dd0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:39.496611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-2b975073-4d3e-4029-a067-d9fa50f10bf6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.079944 Oct 28 08:49:39.497264 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 568/1190] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:39 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:39.528058 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-89831a5a-22a4-4661-8f0b-9c21d530dd0e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.097544 Oct 28 08:49:39.528950 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 623/1191] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:39 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:40.509580 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6f8760a4-8d6e-45f6-9d3e-80434c9f7cb9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:40.510528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6f8760a4-8d6e-45f6-9d3e-80434c9f7cb9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:40.520595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f8760a4-8d6e-45f6-9d3e-80434c9f7cb9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:40.521433 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f8760a4-8d6e-45f6-9d3e-80434c9f7cb9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:40.522068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f8760a4-8d6e-45f6-9d3e-80434c9f7cb9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:40.522516 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6f8760a4-8d6e-45f6-9d3e-80434c9f7cb9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:40.540421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b9bb581f-2055-4d47-902a-0433ed47215a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:40.541443 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b9bb581f-2055-4d47-902a-0433ed47215a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:40.548232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b9bb581f-2055-4d47-902a-0433ed47215a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:40.548671 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b9bb581f-2055-4d47-902a-0433ed47215a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:40.549430 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b9bb581f-2055-4d47-902a-0433ed47215a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:40.549883 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b9bb581f-2055-4d47-902a-0433ed47215a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:40.654676 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6f8760a4-8d6e-45f6-9d3e-80434c9f7cb9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.149716 Oct 28 08:49:40.655356 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 569/1192] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:40 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:40.688403 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b9bb581f-2055-4d47-902a-0433ed47215a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.152112 Oct 28 08:49:40.689114 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 624/1193] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:40 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:41.668021 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1ba667f6-ee6f-4126-b56c-d15eda5dc4a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:41.669098 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1ba667f6-ee6f-4126-b56c-d15eda5dc4a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:41.676186 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1ba667f6-ee6f-4126-b56c-d15eda5dc4a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:41.676637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1ba667f6-ee6f-4126-b56c-d15eda5dc4a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:41.677423 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1ba667f6-ee6f-4126-b56c-d15eda5dc4a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:41.677955 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1ba667f6-ee6f-4126-b56c-d15eda5dc4a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:41.700919 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e3655228-f063-42f7-801b-d3236879304b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:41.701986 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e3655228-f063-42f7-801b-d3236879304b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:41.709831 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e3655228-f063-42f7-801b-d3236879304b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:41.710277 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e3655228-f063-42f7-801b-d3236879304b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:41.711050 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e3655228-f063-42f7-801b-d3236879304b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:41.711481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e3655228-f063-42f7-801b-d3236879304b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:41.740936 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1ba667f6-ee6f-4126-b56c-d15eda5dc4a1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.077103 Oct 28 08:49:41.741597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 570/1194] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:41 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:41.808062 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e3655228-f063-42f7-801b-d3236879304b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.110938 Oct 28 08:49:41.808775 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 625/1195] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:41 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:42.753359 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-95a30cc4-08c4-4d99-962c-3e36385ff720 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:42.754428 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-95a30cc4-08c4-4d99-962c-3e36385ff720 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:42.763606 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-95a30cc4-08c4-4d99-962c-3e36385ff720 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:42.764056 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-95a30cc4-08c4-4d99-962c-3e36385ff720 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:42.764842 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-95a30cc4-08c4-4d99-962c-3e36385ff720 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:42.765322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-95a30cc4-08c4-4d99-962c-3e36385ff720 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:42.820767 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d69a519c-fc9c-452e-9099-bc1a408d9c5c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:42.821763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d69a519c-fc9c-452e-9099-bc1a408d9c5c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:42.829106 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d69a519c-fc9c-452e-9099-bc1a408d9c5c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:42.829575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d69a519c-fc9c-452e-9099-bc1a408d9c5c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:42.830381 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d69a519c-fc9c-452e-9099-bc1a408d9c5c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:42.830812 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d69a519c-fc9c-452e-9099-bc1a408d9c5c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:42.877268 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-95a30cc4-08c4-4d99-962c-3e36385ff720 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.127836 Oct 28 08:49:42.877937 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 571/1196] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:42 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:42.915429 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d69a519c-fc9c-452e-9099-bc1a408d9c5c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.098691 Oct 28 08:49:42.916108 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 626/1197] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:42 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:43.888973 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3349b5c7-a716-4982-aebd-3bd4d3882d39 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:43.889998 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3349b5c7-a716-4982-aebd-3bd4d3882d39 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:43.896990 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3349b5c7-a716-4982-aebd-3bd4d3882d39 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:43.897439 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3349b5c7-a716-4982-aebd-3bd4d3882d39 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:43.898247 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3349b5c7-a716-4982-aebd-3bd4d3882d39 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:43.898681 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3349b5c7-a716-4982-aebd-3bd4d3882d39 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:43.929576 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-86c5395e-73f3-4a5c-b534-38af5d3d2001 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:43.930610 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-86c5395e-73f3-4a5c-b534-38af5d3d2001 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:43.937777 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-86c5395e-73f3-4a5c-b534-38af5d3d2001 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:43.938208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-86c5395e-73f3-4a5c-b534-38af5d3d2001 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:43.938978 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-86c5395e-73f3-4a5c-b534-38af5d3d2001 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:43.939411 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-86c5395e-73f3-4a5c-b534-38af5d3d2001 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:43.987902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3349b5c7-a716-4982-aebd-3bd4d3882d39 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.102837 Oct 28 08:49:43.989366 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 572/1198] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:43 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:44.016663 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-86c5395e-73f3-4a5c-b534-38af5d3d2001 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.092245 Oct 28 08:49:44.018111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 627/1199] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:43 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:45.001025 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f7456ff2-6010-4b7e-8e21-da35a982f145 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:45.002036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f7456ff2-6010-4b7e-8e21-da35a982f145 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:45.010190 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7456ff2-6010-4b7e-8e21-da35a982f145 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:45.010632 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7456ff2-6010-4b7e-8e21-da35a982f145 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:45.011419 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7456ff2-6010-4b7e-8e21-da35a982f145 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:45.011847 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7456ff2-6010-4b7e-8e21-da35a982f145 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:45.029350 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3b07ae18-75d2-41a1-b015-799eba117bc0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:45.030395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3b07ae18-75d2-41a1-b015-799eba117bc0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:45.037671 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3b07ae18-75d2-41a1-b015-799eba117bc0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:45.038150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3b07ae18-75d2-41a1-b015-799eba117bc0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:45.038927 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3b07ae18-75d2-41a1-b015-799eba117bc0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:45.039366 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3b07ae18-75d2-41a1-b015-799eba117bc0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:45.081180 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f7456ff2-6010-4b7e-8e21-da35a982f145 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.084032 Oct 28 08:49:45.081868 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 573/1200] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:44 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:45.100757 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3b07ae18-75d2-41a1-b015-799eba117bc0 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.075296 Oct 28 08:49:45.101419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 628/1201] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:45 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:46.092974 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b0d7f7d8-2c91-4ca7-adc0-b37030d7394c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:46.094023 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b0d7f7d8-2c91-4ca7-adc0-b37030d7394c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:46.102856 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b0d7f7d8-2c91-4ca7-adc0-b37030d7394c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:46.103317 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b0d7f7d8-2c91-4ca7-adc0-b37030d7394c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:46.104225 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b0d7f7d8-2c91-4ca7-adc0-b37030d7394c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:46.104511 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b0d7f7d8-2c91-4ca7-adc0-b37030d7394c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:46.113173 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d5c533d4-b471-40ce-9e87-357e816bbc9c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:46.114298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d5c533d4-b471-40ce-9e87-357e816bbc9c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:46.121194 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5c533d4-b471-40ce-9e87-357e816bbc9c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:46.121714 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5c533d4-b471-40ce-9e87-357e816bbc9c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:46.122654 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5c533d4-b471-40ce-9e87-357e816bbc9c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:46.124010 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5c533d4-b471-40ce-9e87-357e816bbc9c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:46.177668 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b0d7f7d8-2c91-4ca7-adc0-b37030d7394c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.088524 Oct 28 08:49:46.181545 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 574/1202] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:46 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:46.183272 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-362387357", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-21201921", "security_groups": [{"name": "tempest-secgroup-smoke-1557192688"}], "block_device_mapping_v2": [{"uuid": "d82852cb-435d-43a9-83bf-e8886c9d9a1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c4e2068-440b-4c5b-b064-f6b110ee163c"}]}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:46.192841 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d5c533d4-b471-40ce-9e87-357e816bbc9c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.083207 Oct 28 08:49:46.193856 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 629/1203] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:46 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:46.288898 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] validate_networks() for [('5c4e2068-440b-4c5b-b064-f6b110ee163c', None, None, None, None, None)] {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:49:46.671988 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:49:46.672448 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:49:46.672940 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:49:46.673339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:49:46.673740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:49:46.683864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:46.684302 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:46.685094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:46.685516 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:46.703114 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Getting quotas for project 3f8be4e851fc4c5bb989b23068ab50b0. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:49:46.706874 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Getting quotas for user c731f20a04204d9ea0b04a20f2e72577 and project 3f8be4e851fc4c5bb989b23068ab50b0. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:49:46.765070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:49:46.767348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d82852cb-435d-43a9-83bf-e8886c9d9a1f',volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:49:46.905345 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-43dc88d2-18cc-49ad-bdc7-a96a3b267c81 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.725776 Oct 28 08:49:46.906018 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 575/1204] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:49:46 2021] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:49:46.916815 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-060dd1a3-2453-4206-b1b3-f9a7177989fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:46.917513 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-060dd1a3-2453-4206-b1b3-f9a7177989fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:46.973762 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-060dd1a3-2453-4206-b1b3-f9a7177989fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:46.980741 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-060dd1a3-2453-4206-b1b3-f9a7177989fb tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1092 microversion: 2.1 time: 0.067925 Oct 28 08:49:46.981317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 630/1205] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:46 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:49:47.188429 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f3ce9d91-15af-4115-afb1-98aab28567a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:47.189858 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f3ce9d91-15af-4115-afb1-98aab28567a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:47.205315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7c976b32-ae26-4056-a09c-e7ddf683d0b5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:47.206271 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7c976b32-ae26-4056-a09c-e7ddf683d0b5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:47.212827 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7c976b32-ae26-4056-a09c-e7ddf683d0b5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:47.213274 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7c976b32-ae26-4056-a09c-e7ddf683d0b5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:47.214082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7c976b32-ae26-4056-a09c-e7ddf683d0b5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:47.214515 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7c976b32-ae26-4056-a09c-e7ddf683d0b5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:47.218311 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f3ce9d91-15af-4115-afb1-98aab28567a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:47.218820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f3ce9d91-15af-4115-afb1-98aab28567a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:47.219644 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f3ce9d91-15af-4115-afb1-98aab28567a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:47.220080 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f3ce9d91-15af-4115-afb1-98aab28567a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:47.303759 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f3ce9d91-15af-4115-afb1-98aab28567a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.118763 Oct 28 08:49:47.308351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 576/1206] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:47 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:47.312160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7c976b32-ae26-4056-a09c-e7ddf683d0b5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.106132 Oct 28 08:49:47.312160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 631/1207] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:47 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:47.999991 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6887e673-4f43-48ea-a782-12b6339e9522 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:48.000708 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6887e673-4f43-48ea-a782-12b6339e9522 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:48.008891 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6887e673-4f43-48ea-a782-12b6339e9522 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:48.009357 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6887e673-4f43-48ea-a782-12b6339e9522 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:48.010244 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6887e673-4f43-48ea-a782-12b6339e9522 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:48.010685 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6887e673-4f43-48ea-a782-12b6339e9522 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:48.080257 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6887e673-4f43-48ea-a782-12b6339e9522 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:48.091178 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6887e673-4f43-48ea-a782-12b6339e9522 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1208 microversion: 2.1 time: 0.095971 Oct 28 08:49:48.092873 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 577/1208] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:47 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:49:48.316771 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-68766754-8af8-49fc-bc50-be8bd7fd8049 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:48.319264 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-68766754-8af8-49fc-bc50-be8bd7fd8049 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:48.322026 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4dc33f24-85c4-4549-b4de-1903cad42707 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:48.323674 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4dc33f24-85c4-4549-b4de-1903cad42707 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:48.326471 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68766754-8af8-49fc-bc50-be8bd7fd8049 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:48.327064 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68766754-8af8-49fc-bc50-be8bd7fd8049 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:48.327960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68766754-8af8-49fc-bc50-be8bd7fd8049 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:48.328737 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-68766754-8af8-49fc-bc50-be8bd7fd8049 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:48.335047 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4dc33f24-85c4-4549-b4de-1903cad42707 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:48.335730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4dc33f24-85c4-4549-b4de-1903cad42707 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:48.336773 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4dc33f24-85c4-4549-b4de-1903cad42707 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:48.337816 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4dc33f24-85c4-4549-b4de-1903cad42707 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:48.404942 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-68766754-8af8-49fc-bc50-be8bd7fd8049 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.092445 Oct 28 08:49:48.405692 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 632/1209] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:48 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:48.411175 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4dc33f24-85c4-4549-b4de-1903cad42707 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.095064 Oct 28 08:49:48.413106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 578/1210] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:48 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:49.108843 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a1e84eb2-a045-456b-a30d-92596478aba0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:49.109664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a1e84eb2-a045-456b-a30d-92596478aba0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:49.120402 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a1e84eb2-a045-456b-a30d-92596478aba0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:49.121048 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a1e84eb2-a045-456b-a30d-92596478aba0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:49.121983 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a1e84eb2-a045-456b-a30d-92596478aba0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:49.122432 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a1e84eb2-a045-456b-a30d-92596478aba0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:49.258832 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a1e84eb2-a045-456b-a30d-92596478aba0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:49.266543 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a1e84eb2-a045-456b-a30d-92596478aba0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.162052 Oct 28 08:49:49.267109 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 633/1211] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:49 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:49:49.420614 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9af7c9e6-79f1-4f77-8910-31c6594f2a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:49.421627 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9af7c9e6-79f1-4f77-8910-31c6594f2a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:49.422716 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-cb0a6af3-a638-4b0d-b88f-b486a7609144 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:49.424074 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-cb0a6af3-a638-4b0d-b88f-b486a7609144 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:49.430985 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9af7c9e6-79f1-4f77-8910-31c6594f2a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:49.431653 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9af7c9e6-79f1-4f77-8910-31c6594f2a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:49.432637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9af7c9e6-79f1-4f77-8910-31c6594f2a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:49.433208 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9af7c9e6-79f1-4f77-8910-31c6594f2a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:49.443353 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cb0a6af3-a638-4b0d-b88f-b486a7609144 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:49.443892 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cb0a6af3-a638-4b0d-b88f-b486a7609144 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:49.445361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cb0a6af3-a638-4b0d-b88f-b486a7609144 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:49.446338 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cb0a6af3-a638-4b0d-b88f-b486a7609144 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:49.509889 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9af7c9e6-79f1-4f77-8910-31c6594f2a55 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.095748 Oct 28 08:49:49.510654 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 579/1212] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:49 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:49.522059 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-cb0a6af3-a638-4b0d-b88f-b486a7609144 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.102734 Oct 28 08:49:49.522968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 634/1213] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:49 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:49.591474 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-2b49d36c-2088-4d28-9a54-0b8fd9c5d635 req-8bc37458-81d2-4af7-95a6-8adc3c00c4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98", "tag": "58fe07ec-e0d5-48c7-a254-bcaf6285fb85"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:49.591924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:49:49.591924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:49:49.609285 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-2b49d36c-2088-4d28-9a54-0b8fd9c5d635 req-8bc37458-81d2-4af7-95a6-8adc3c00c4a0 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:49.609629 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-2b49d36c-2088-4d28-9a54-0b8fd9c5d635 req-8bc37458-81d2-4af7-95a6-8adc3c00c4a0 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:49.625541 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-2b49d36c-2088-4d28-9a54-0b8fd9c5d635 req-8bc37458-81d2-4af7-95a6-8adc3c00c4a0 service nova] Creating event network-changed:58fe07ec-e0d5-48c7-a254-bcaf6285fb85 for instance dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 on hv-cinder-81566 Oct 28 08:49:49.631892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-2b49d36c-2088-4d28-9a54-0b8fd9c5d635 req-8bc37458-81d2-4af7-95a6-8adc3c00c4a0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045797 Oct 28 08:49:49.632516 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 580/1214] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:49:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:49:50.284983 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8e583582-d02e-4b0b-99a6-27c81da85e30 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:50.286850 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8e583582-d02e-4b0b-99a6-27c81da85e30 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:50.294351 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8e583582-d02e-4b0b-99a6-27c81da85e30 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:50.294799 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8e583582-d02e-4b0b-99a6-27c81da85e30 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:50.295600 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8e583582-d02e-4b0b-99a6-27c81da85e30 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:50.296037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8e583582-d02e-4b0b-99a6-27c81da85e30 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:50.431004 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8e583582-d02e-4b0b-99a6-27c81da85e30 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:50.438500 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8e583582-d02e-4b0b-99a6-27c81da85e30 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.157534 Oct 28 08:49:50.439081 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 635/1215] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:50 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:49:50.522746 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-519b1ca0-d48f-4d2e-80e3-c738a7b99fe0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:50.523784 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-519b1ca0-d48f-4d2e-80e3-c738a7b99fe0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:50.531310 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-519b1ca0-d48f-4d2e-80e3-c738a7b99fe0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:50.532209 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-519b1ca0-d48f-4d2e-80e3-c738a7b99fe0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:50.532553 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-519b1ca0-d48f-4d2e-80e3-c738a7b99fe0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:50.532986 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-519b1ca0-d48f-4d2e-80e3-c738a7b99fe0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:50.535188 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1bf94682-c0bb-4aa3-aa47-13aaf915f16f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:50.536852 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1bf94682-c0bb-4aa3-aa47-13aaf915f16f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:50.543302 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1bf94682-c0bb-4aa3-aa47-13aaf915f16f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:50.543865 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1bf94682-c0bb-4aa3-aa47-13aaf915f16f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:50.544736 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1bf94682-c0bb-4aa3-aa47-13aaf915f16f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:50.545263 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1bf94682-c0bb-4aa3-aa47-13aaf915f16f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:50.609409 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-519b1ca0-d48f-4d2e-80e3-c738a7b99fe0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.091017 Oct 28 08:49:50.610334 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 581/1216] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:50 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:50.615826 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1bf94682-c0bb-4aa3-aa47-13aaf915f16f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.084739 Oct 28 08:49:50.616528 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 636/1217] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:50 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:51.456434 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b5dc1cf0-04b3-46df-a7cc-4315ea7b478f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:51.457137 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b5dc1cf0-04b3-46df-a7cc-4315ea7b478f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:51.464574 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5dc1cf0-04b3-46df-a7cc-4315ea7b478f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:51.465024 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5dc1cf0-04b3-46df-a7cc-4315ea7b478f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:51.465876 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5dc1cf0-04b3-46df-a7cc-4315ea7b478f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:51.466308 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b5dc1cf0-04b3-46df-a7cc-4315ea7b478f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:51.600268 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b5dc1cf0-04b3-46df-a7cc-4315ea7b478f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:51.607759 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b5dc1cf0-04b3-46df-a7cc-4315ea7b478f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.155464 Oct 28 08:49:51.608365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 582/1218] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:51 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:49:51.626236 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-80ed1f8b-f782-4f28-81b4-a75a18f3a2d2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:51.627255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-80ed1f8b-f782-4f28-81b4-a75a18f3a2d2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:51.627408 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-284f2875-5b32-447e-a785-620e79ec9c9b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:51.628351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-284f2875-5b32-447e-a785-620e79ec9c9b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:51.635128 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-284f2875-5b32-447e-a785-620e79ec9c9b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:51.635570 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-284f2875-5b32-447e-a785-620e79ec9c9b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:51.635755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80ed1f8b-f782-4f28-81b4-a75a18f3a2d2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:51.636211 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80ed1f8b-f782-4f28-81b4-a75a18f3a2d2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:51.636405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-284f2875-5b32-447e-a785-620e79ec9c9b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:51.636845 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-284f2875-5b32-447e-a785-620e79ec9c9b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:51.636990 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80ed1f8b-f782-4f28-81b4-a75a18f3a2d2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:51.637408 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80ed1f8b-f782-4f28-81b4-a75a18f3a2d2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:51.699570 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-284f2875-5b32-447e-a785-620e79ec9c9b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.075560 Oct 28 08:49:51.703474 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 583/1219] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:51 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:51.703648 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-80ed1f8b-f782-4f28-81b4-a75a18f3a2d2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.081379 Oct 28 08:49:51.703963 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 637/1220] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:51 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:52.626313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9158f7f9-565e-4e9f-8461-9c91a8cc39be tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:52.627012 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9158f7f9-565e-4e9f-8461-9c91a8cc39be tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:52.634447 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9158f7f9-565e-4e9f-8461-9c91a8cc39be tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:52.634895 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9158f7f9-565e-4e9f-8461-9c91a8cc39be tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:52.635665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9158f7f9-565e-4e9f-8461-9c91a8cc39be tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:52.636094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9158f7f9-565e-4e9f-8461-9c91a8cc39be tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:52.716005 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-44cae29a-1931-406f-8028-d54d6fabb4d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:52.717257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-44cae29a-1931-406f-8028-d54d6fabb4d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:52.725411 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-44cae29a-1931-406f-8028-d54d6fabb4d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:52.726125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-44cae29a-1931-406f-8028-d54d6fabb4d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:52.726903 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-44cae29a-1931-406f-8028-d54d6fabb4d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:52.727352 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-44cae29a-1931-406f-8028-d54d6fabb4d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:52.768492 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9158f7f9-565e-4e9f-8461-9c91a8cc39be tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:52.777291 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9158f7f9-565e-4e9f-8461-9c91a8cc39be tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.155010 Oct 28 08:49:52.777877 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 584/1221] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:52 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:49:52.782369 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-21b17d14-7a51-471a-babc-bc60cbb9ffb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:52.784347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-21b17d14-7a51-471a-babc-bc60cbb9ffb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:52.791313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21b17d14-7a51-471a-babc-bc60cbb9ffb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:52.791747 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21b17d14-7a51-471a-babc-bc60cbb9ffb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:52.792511 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21b17d14-7a51-471a-babc-bc60cbb9ffb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:52.792937 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21b17d14-7a51-471a-babc-bc60cbb9ffb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:52.815364 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-44cae29a-1931-406f-8028-d54d6fabb4d5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.107480 Oct 28 08:49:52.816041 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 638/1222] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:52 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:52.856581 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-21b17d14-7a51-471a-babc-bc60cbb9ffb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.077386 Oct 28 08:49:52.857233 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 585/1223] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:52 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:53.795504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-195887ab-3017-448c-aea5-d5c8c0bbe7f7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:53.796195 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-195887ab-3017-448c-aea5-d5c8c0bbe7f7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:53.804146 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-195887ab-3017-448c-aea5-d5c8c0bbe7f7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:53.804717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-195887ab-3017-448c-aea5-d5c8c0bbe7f7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:53.805655 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-195887ab-3017-448c-aea5-d5c8c0bbe7f7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:53.806134 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-195887ab-3017-448c-aea5-d5c8c0bbe7f7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:53.827964 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-56339206-38a5-498e-9776-9ee1cca81963 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:53.828976 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-56339206-38a5-498e-9776-9ee1cca81963 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:53.836091 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-56339206-38a5-498e-9776-9ee1cca81963 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:53.836540 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-56339206-38a5-498e-9776-9ee1cca81963 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:53.837317 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-56339206-38a5-498e-9776-9ee1cca81963 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:53.837756 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-56339206-38a5-498e-9776-9ee1cca81963 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:53.899485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-56339206-38a5-498e-9776-9ee1cca81963 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.075295 Oct 28 08:49:53.900384 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 586/1224] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:53 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:53.905094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-46c89d97-0e72-4091-86d0-eae7b801b034 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:53.906130 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-46c89d97-0e72-4091-86d0-eae7b801b034 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:53.913625 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-46c89d97-0e72-4091-86d0-eae7b801b034 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:53.914101 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-46c89d97-0e72-4091-86d0-eae7b801b034 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:53.914909 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-46c89d97-0e72-4091-86d0-eae7b801b034 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:53.915346 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-46c89d97-0e72-4091-86d0-eae7b801b034 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:53.944479 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-195887ab-3017-448c-aea5-d5c8c0bbe7f7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:53.952148 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-195887ab-3017-448c-aea5-d5c8c0bbe7f7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.160674 Oct 28 08:49:53.952722 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 639/1225] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:53 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:49:53.979628 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-46c89d97-0e72-4091-86d0-eae7b801b034 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.078001 Oct 28 08:49:53.980318 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 587/1226] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:53 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:54.911484 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8fef5cc4-a4bb-4a1b-94fd-98c922e72671 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:54.913331 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8fef5cc4-a4bb-4a1b-94fd-98c922e72671 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:54.919910 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8fef5cc4-a4bb-4a1b-94fd-98c922e72671 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:54.920346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8fef5cc4-a4bb-4a1b-94fd-98c922e72671 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:54.921159 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8fef5cc4-a4bb-4a1b-94fd-98c922e72671 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:54.921587 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8fef5cc4-a4bb-4a1b-94fd-98c922e72671 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:54.969256 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-87240dbe-aa5c-43bd-a6d4-81563ad45ccc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:54.969976 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-87240dbe-aa5c-43bd-a6d4-81563ad45ccc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:54.977136 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-87240dbe-aa5c-43bd-a6d4-81563ad45ccc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:54.977638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-87240dbe-aa5c-43bd-a6d4-81563ad45ccc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:54.978467 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-87240dbe-aa5c-43bd-a6d4-81563ad45ccc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:54.978899 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-87240dbe-aa5c-43bd-a6d4-81563ad45ccc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:54.989196 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8fef5cc4-a4bb-4a1b-94fd-98c922e72671 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.081063 Oct 28 08:49:54.993144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 640/1227] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:54 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:54.996060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d58a7e49-aa7a-487b-97e3-02c1c8040f9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:54.996901 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d58a7e49-aa7a-487b-97e3-02c1c8040f9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:55.004184 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d58a7e49-aa7a-487b-97e3-02c1c8040f9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:55.005160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d58a7e49-aa7a-487b-97e3-02c1c8040f9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:55.006228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d58a7e49-aa7a-487b-97e3-02c1c8040f9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:55.006707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d58a7e49-aa7a-487b-97e3-02c1c8040f9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:55.072119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d58a7e49-aa7a-487b-97e3-02c1c8040f9f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.080234 Oct 28 08:49:55.072802 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 641/1228] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:54 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:55.117174 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-87240dbe-aa5c-43bd-a6d4-81563ad45ccc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:55.124966 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-87240dbe-aa5c-43bd-a6d4-81563ad45ccc tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.159699 Oct 28 08:49:55.125554 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 588/1229] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:54 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:49:56.004253 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4bd37208-2890-4fc2-94b2-6c5e4a81617d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:56.005176 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4bd37208-2890-4fc2-94b2-6c5e4a81617d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:56.013085 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4bd37208-2890-4fc2-94b2-6c5e4a81617d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:56.013534 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4bd37208-2890-4fc2-94b2-6c5e4a81617d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:56.014357 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4bd37208-2890-4fc2-94b2-6c5e4a81617d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:56.014795 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4bd37208-2890-4fc2-94b2-6c5e4a81617d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:56.075066 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4bd37208-2890-4fc2-94b2-6c5e4a81617d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.074692 Oct 28 08:49:56.075728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 642/1230] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:55 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:56.084650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-76773893-7f4a-483e-adfe-551df3362098 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:56.085577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-76773893-7f4a-483e-adfe-551df3362098 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:56.091859 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-76773893-7f4a-483e-adfe-551df3362098 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:56.092304 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-76773893-7f4a-483e-adfe-551df3362098 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:56.093072 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-76773893-7f4a-483e-adfe-551df3362098 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:56.093503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-76773893-7f4a-483e-adfe-551df3362098 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:56.142712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9506a1d3-d305-47f4-a396-fbad49a6bf04 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:56.143407 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9506a1d3-d305-47f4-a396-fbad49a6bf04 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:56.151165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9506a1d3-d305-47f4-a396-fbad49a6bf04 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:56.151994 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9506a1d3-d305-47f4-a396-fbad49a6bf04 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:56.152738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9506a1d3-d305-47f4-a396-fbad49a6bf04 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:56.153230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9506a1d3-d305-47f4-a396-fbad49a6bf04 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:56.154438 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-76773893-7f4a-483e-adfe-551df3362098 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 28661 microversion: 2.20 time: 0.074003 Oct 28 08:49:56.156005 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 589/1231] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:56 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 28661 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:56.287546 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9506a1d3-d305-47f4-a396-fbad49a6bf04 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:56.295902 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9506a1d3-d305-47f4-a396-fbad49a6bf04 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.157110 Oct 28 08:49:56.296468 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 643/1232] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:56 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:49:57.088419 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1225f6bf-3e2d-4b11-b9a0-b7f9daaa9cfe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:57.089415 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1225f6bf-3e2d-4b11-b9a0-b7f9daaa9cfe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:57.098961 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1225f6bf-3e2d-4b11-b9a0-b7f9daaa9cfe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:57.099675 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1225f6bf-3e2d-4b11-b9a0-b7f9daaa9cfe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:57.100915 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1225f6bf-3e2d-4b11-b9a0-b7f9daaa9cfe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:57.101597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1225f6bf-3e2d-4b11-b9a0-b7f9daaa9cfe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:57.167030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-383f5aac-4e33-4681-8ee0-0e4adcb294c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:57.167938 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-383f5aac-4e33-4681-8ee0-0e4adcb294c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:57.174184 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-383f5aac-4e33-4681-8ee0-0e4adcb294c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:57.174630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-383f5aac-4e33-4681-8ee0-0e4adcb294c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:57.175386 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-383f5aac-4e33-4681-8ee0-0e4adcb294c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:57.175816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-383f5aac-4e33-4681-8ee0-0e4adcb294c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:57.183619 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1225f6bf-3e2d-4b11-b9a0-b7f9daaa9cfe tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 28782 microversion: 2.1 time: 0.099073 Oct 28 08:49:57.184282 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 590/1233] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:57 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 28782 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:57.256582 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-383f5aac-4e33-4681-8ee0-0e4adcb294c8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 30195 microversion: 2.20 time: 0.093217 Oct 28 08:49:57.257264 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 644/1234] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:57 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 30195 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:57.313774 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-853bd4c2-2429-4463-993b-1ccbeab94ab0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:57.314490 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-853bd4c2-2429-4463-993b-1ccbeab94ab0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:57.322208 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-853bd4c2-2429-4463-993b-1ccbeab94ab0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:57.322661 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-853bd4c2-2429-4463-993b-1ccbeab94ab0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:57.323445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-853bd4c2-2429-4463-993b-1ccbeab94ab0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:57.323881 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-853bd4c2-2429-4463-993b-1ccbeab94ab0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:57.708152 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-853bd4c2-2429-4463-993b-1ccbeab94ab0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:57.715791 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-853bd4c2-2429-4463-993b-1ccbeab94ab0 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.406075 Oct 28 08:49:57.716480 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 591/1235] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:57 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:49:58.196256 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9f9201b8-d9f4-4ba9-aee4-ea0314d6b15e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:58.197257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9f9201b8-d9f4-4ba9-aee4-ea0314d6b15e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:58.204141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9201b8-d9f4-4ba9-aee4-ea0314d6b15e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:58.204576 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9201b8-d9f4-4ba9-aee4-ea0314d6b15e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:58.205335 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9201b8-d9f4-4ba9-aee4-ea0314d6b15e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:58.205763 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f9201b8-d9f4-4ba9-aee4-ea0314d6b15e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:58.268412 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f5e0a92b-5cc1-4ead-b523-a6f9e207b31c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:58.269355 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f5e0a92b-5cc1-4ead-b523-a6f9e207b31c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:58.276968 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5e0a92b-5cc1-4ead-b523-a6f9e207b31c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:58.277416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5e0a92b-5cc1-4ead-b523-a6f9e207b31c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:58.278209 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5e0a92b-5cc1-4ead-b523-a6f9e207b31c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:58.278646 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f5e0a92b-5cc1-4ead-b523-a6f9e207b31c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:58.288862 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9f9201b8-d9f4-4ba9-aee4-ea0314d6b15e tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 30242 microversion: 2.1 time: 0.096492 Oct 28 08:49:58.293370 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 645/1236] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:58 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 30242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:58.357118 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f5e0a92b-5cc1-4ead-b523-a6f9e207b31c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 31829 microversion: 2.20 time: 0.092182 Oct 28 08:49:58.357793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 592/1237] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:58 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 31829 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:58.735071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7ec85b7c-c77f-407e-9a47-1ff83a024b47 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:58.735766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7ec85b7c-c77f-407e-9a47-1ff83a024b47 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:58.742700 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7ec85b7c-c77f-407e-9a47-1ff83a024b47 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:58.743141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7ec85b7c-c77f-407e-9a47-1ff83a024b47 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:58.743913 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7ec85b7c-c77f-407e-9a47-1ff83a024b47 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:58.744338 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7ec85b7c-c77f-407e-9a47-1ff83a024b47 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:58.882960 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-7ec85b7c-c77f-407e-9a47-1ff83a024b47 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:58.891097 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7ec85b7c-c77f-407e-9a47-1ff83a024b47 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.160032 Oct 28 08:49:58.891675 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 646/1238] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:58 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:49:59.302438 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d40a0569-a713-40b3-8d8c-952fd5b548fb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:59.303332 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d40a0569-a713-40b3-8d8c-952fd5b548fb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:59.310198 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d40a0569-a713-40b3-8d8c-952fd5b548fb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:59.310639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d40a0569-a713-40b3-8d8c-952fd5b548fb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:59.311405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d40a0569-a713-40b3-8d8c-952fd5b548fb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:59.311831 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d40a0569-a713-40b3-8d8c-952fd5b548fb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:59.369684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0e4cd6a2-b6b1-4e35-af9f-b3140881700c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:59.370622 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0e4cd6a2-b6b1-4e35-af9f-b3140881700c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:59.376616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0e4cd6a2-b6b1-4e35-af9f-b3140881700c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:59.377060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0e4cd6a2-b6b1-4e35-af9f-b3140881700c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:59.377839 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0e4cd6a2-b6b1-4e35-af9f-b3140881700c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:59.378270 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0e4cd6a2-b6b1-4e35-af9f-b3140881700c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:59.399289 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d40a0569-a713-40b3-8d8c-952fd5b548fb tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 32041 microversion: 2.1 time: 0.101578 Oct 28 08:49:59.400846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 593/1239] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:59 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 32041 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:59.452795 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0e4cd6a2-b6b1-4e35-af9f-b3140881700c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 33172 microversion: 2.20 time: 0.086699 Oct 28 08:49:59.453482 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 647/1240] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:59 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 33172 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:59.908635 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f2c05616-e66c-42be-b96e-31de11d4676c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:59.909408 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f2c05616-e66c-42be-b96e-31de11d4676c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:59.917124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2c05616-e66c-42be-b96e-31de11d4676c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:59.917571 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2c05616-e66c-42be-b96e-31de11d4676c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:59.918472 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2c05616-e66c-42be-b96e-31de11d4676c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:59.918904 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f2c05616-e66c-42be-b96e-31de11d4676c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:00.048662 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f2c05616-e66c-42be-b96e-31de11d4676c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:00.057582 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f2c05616-e66c-42be-b96e-31de11d4676c tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.153040 Oct 28 08:50:00.058209 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 594/1241] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:49:59 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:00.411685 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-79ef28a0-ecdf-4b62-9773-bb012a72ebf6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:00.413042 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-79ef28a0-ecdf-4b62-9773-bb012a72ebf6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:00.420167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79ef28a0-ecdf-4b62-9773-bb012a72ebf6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:00.420613 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79ef28a0-ecdf-4b62-9773-bb012a72ebf6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:00.421383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79ef28a0-ecdf-4b62-9773-bb012a72ebf6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:00.421821 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79ef28a0-ecdf-4b62-9773-bb012a72ebf6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:00.465290 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-dc65696b-1778-4bdf-9f5c-9a16b1e37aa8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:00.467055 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-dc65696b-1778-4bdf-9f5c-9a16b1e37aa8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:00.473247 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dc65696b-1778-4bdf-9f5c-9a16b1e37aa8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:00.473694 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dc65696b-1778-4bdf-9f5c-9a16b1e37aa8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:00.474492 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dc65696b-1778-4bdf-9f5c-9a16b1e37aa8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:00.474926 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-dc65696b-1778-4bdf-9f5c-9a16b1e37aa8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:00.521254 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-79ef28a0-ecdf-4b62-9773-bb012a72ebf6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 36010 microversion: 2.1 time: 0.113333 Oct 28 08:50:00.521931 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 648/1242] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:00 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 36010 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:50:00.576070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-dc65696b-1778-4bdf-9f5c-9a16b1e37aa8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 33829 microversion: 2.20 time: 0.115034 Oct 28 08:50:00.576722 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 595/1243] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:50:00 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 33829 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:50:01.074955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-61315189-86dc-418f-b70d-2418dd2a9159 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:01.075685 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-61315189-86dc-418f-b70d-2418dd2a9159 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:01.083065 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61315189-86dc-418f-b70d-2418dd2a9159 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:01.083518 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61315189-86dc-418f-b70d-2418dd2a9159 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:01.084288 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61315189-86dc-418f-b70d-2418dd2a9159 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:01.084719 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-61315189-86dc-418f-b70d-2418dd2a9159 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:01.266968 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-61315189-86dc-418f-b70d-2418dd2a9159 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:01.275709 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-61315189-86dc-418f-b70d-2418dd2a9159 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.204735 Oct 28 08:50:01.276290 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 649/1244] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:01 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:01.358638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-21ddd8d6-4293-4e5b-9169-654908b2060b req-65a4e86d-b19a-48bb-9250-133cfe4f8578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98", "name": "network-vif-plugged", "status": "completed", "tag": "58fe07ec-e0d5-48c7-a254-bcaf6285fb85"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:01.360213 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:50:01.360213 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:50:01.369231 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-21ddd8d6-4293-4e5b-9169-654908b2060b req-65a4e86d-b19a-48bb-9250-133cfe4f8578 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:01.369670 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-21ddd8d6-4293-4e5b-9169-654908b2060b req-65a4e86d-b19a-48bb-9250-133cfe4f8578 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:01.382807 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-21ddd8d6-4293-4e5b-9169-654908b2060b req-65a4e86d-b19a-48bb-9250-133cfe4f8578 service nova] Creating event network-vif-plugged:58fe07ec-e0d5-48c7-a254-bcaf6285fb85 for instance dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 on hv-cinder-81566 Oct 28 08:50:01.387659 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-21ddd8d6-4293-4e5b-9169-654908b2060b req-65a4e86d-b19a-48bb-9250-133cfe4f8578 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033608 Oct 28 08:50:01.388249 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 596/1245] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:50:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:01.532714 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-97c6758e-7f61-4cb8-b356-5039cc14025b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:01.534019 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-97c6758e-7f61-4cb8-b356-5039cc14025b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:01.540995 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97c6758e-7f61-4cb8-b356-5039cc14025b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:01.541488 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97c6758e-7f61-4cb8-b356-5039cc14025b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:01.542382 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97c6758e-7f61-4cb8-b356-5039cc14025b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:01.542733 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-97c6758e-7f61-4cb8-b356-5039cc14025b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:01.589901 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-38c6aec8-afc3-4ccf-96e9-912f70272ff0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:01.590930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-38c6aec8-afc3-4ccf-96e9-912f70272ff0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:01.597612 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38c6aec8-afc3-4ccf-96e9-912f70272ff0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:01.598023 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38c6aec8-afc3-4ccf-96e9-912f70272ff0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:01.599508 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38c6aec8-afc3-4ccf-96e9-912f70272ff0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:01.599953 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38c6aec8-afc3-4ccf-96e9-912f70272ff0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:01.637589 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-97c6758e-7f61-4cb8-b356-5039cc14025b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 36821 microversion: 2.1 time: 0.108473 Oct 28 08:50:01.638663 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 650/1246] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:01 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 36821 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:50:01.693892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-38c6aec8-afc3-4ccf-96e9-912f70272ff0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 35012 microversion: 2.20 time: 0.108615 Oct 28 08:50:01.694549 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 597/1247] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:50:01 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 35012 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:50:02.294101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-cb40e7c8-6bb2-4c2b-abe7-82ad5b41abdf tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:02.294866 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-cb40e7c8-6bb2-4c2b-abe7-82ad5b41abdf tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:02.303204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cb40e7c8-6bb2-4c2b-abe7-82ad5b41abdf tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:02.303683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cb40e7c8-6bb2-4c2b-abe7-82ad5b41abdf tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:02.304553 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cb40e7c8-6bb2-4c2b-abe7-82ad5b41abdf tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:02.305025 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cb40e7c8-6bb2-4c2b-abe7-82ad5b41abdf tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:02.430855 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-cb40e7c8-6bb2-4c2b-abe7-82ad5b41abdf tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:02.438837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-cb40e7c8-6bb2-4c2b-abe7-82ad5b41abdf tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.149228 Oct 28 08:50:02.439602 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 651/1248] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:02 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:02.649964 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c37fdddf-3050-430d-a598-d91b4700382d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:02.650877 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c37fdddf-3050-430d-a598-d91b4700382d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:02.657596 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c37fdddf-3050-430d-a598-d91b4700382d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:02.658068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c37fdddf-3050-430d-a598-d91b4700382d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:02.658831 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c37fdddf-3050-430d-a598-d91b4700382d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:02.659264 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c37fdddf-3050-430d-a598-d91b4700382d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:02.705932 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e9870421-7d04-424c-a0ce-f1056f976b79 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:02.706849 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e9870421-7d04-424c-a0ce-f1056f976b79 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:02.713682 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e9870421-7d04-424c-a0ce-f1056f976b79 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:02.714158 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e9870421-7d04-424c-a0ce-f1056f976b79 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:02.714926 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e9870421-7d04-424c-a0ce-f1056f976b79 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:02.715367 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e9870421-7d04-424c-a0ce-f1056f976b79 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:02.863411 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c37fdddf-3050-430d-a598-d91b4700382d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 37771 microversion: 2.1 time: 0.218238 Oct 28 08:50:02.864206 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 598/1249] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:02 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 37771 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:50:02.875448 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e9870421-7d04-424c-a0ce-f1056f976b79 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 35890 microversion: 2.20 time: 0.173386 Oct 28 08:50:02.876226 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 652/1250] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:50:02 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 35890 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:50:03.456640 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9c33cfa6-20c6-41b0-aa35-4016f1b76a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:03.457354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9c33cfa6-20c6-41b0-aa35-4016f1b76a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:03.464275 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9c33cfa6-20c6-41b0-aa35-4016f1b76a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:03.464721 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9c33cfa6-20c6-41b0-aa35-4016f1b76a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:03.465498 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9c33cfa6-20c6-41b0-aa35-4016f1b76a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:03.466096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9c33cfa6-20c6-41b0-aa35-4016f1b76a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:03.665843 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9c33cfa6-20c6-41b0-aa35-4016f1b76a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:03.673572 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9c33cfa6-20c6-41b0-aa35-4016f1b76a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1264 microversion: 2.1 time: 0.220954 Oct 28 08:50:03.674176 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 599/1251] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:03 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:03.876469 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f7cb241b-4a3b-4db6-9886-5bfbdb33dc3b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:03.877900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f7cb241b-4a3b-4db6-9886-5bfbdb33dc3b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:03.885192 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7cb241b-4a3b-4db6-9886-5bfbdb33dc3b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:03.885637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7cb241b-4a3b-4db6-9886-5bfbdb33dc3b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:03.886433 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7cb241b-4a3b-4db6-9886-5bfbdb33dc3b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:03.886858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f7cb241b-4a3b-4db6-9886-5bfbdb33dc3b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:03.889042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7b86c2f2-5780-46ab-bd19-8cad1dc73c7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:03.890256 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7b86c2f2-5780-46ab-bd19-8cad1dc73c7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:03.896821 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7b86c2f2-5780-46ab-bd19-8cad1dc73c7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:03.897268 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7b86c2f2-5780-46ab-bd19-8cad1dc73c7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:03.898069 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7b86c2f2-5780-46ab-bd19-8cad1dc73c7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:03.898506 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7b86c2f2-5780-46ab-bd19-8cad1dc73c7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:04.045637 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7b86c2f2-5780-46ab-bd19-8cad1dc73c7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 37062 microversion: 2.20 time: 0.160823 Oct 28 08:50:04.046337 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 600/1252] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:50:03 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 37062 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:50:04.059125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f7cb241b-4a3b-4db6-9886-5bfbdb33dc3b tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 38309 microversion: 2.1 time: 0.186782 Oct 28 08:50:04.059797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 653/1253] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:03 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 38309 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:50:04.691354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-846f906f-760c-484c-94b5-80765eee24b8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:04.692329 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-846f906f-760c-484c-94b5-80765eee24b8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:04.706831 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-846f906f-760c-484c-94b5-80765eee24b8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:04.707283 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-846f906f-760c-484c-94b5-80765eee24b8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:04.708104 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-846f906f-760c-484c-94b5-80765eee24b8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:04.708757 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-846f906f-760c-484c-94b5-80765eee24b8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:04.838378 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-846f906f-760c-484c-94b5-80765eee24b8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:04.846430 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-846f906f-760c-484c-94b5-80765eee24b8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1450 microversion: 2.1 time: 0.159064 Oct 28 08:50:04.847007 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 601/1254] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:04 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:04.864237 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f8ade102-2bb2-44ff-8300-ba6d24d71a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:04.865138 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f8ade102-2bb2-44ff-8300-ba6d24d71a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:04.872128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f8ade102-2bb2-44ff-8300-ba6d24d71a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:04.872574 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f8ade102-2bb2-44ff-8300-ba6d24d71a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:04.873341 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f8ade102-2bb2-44ff-8300-ba6d24d71a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:04.873817 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f8ade102-2bb2-44ff-8300-ba6d24d71a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:05.013234 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f8ade102-2bb2-44ff-8300-ba6d24d71a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:05.021970 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f8ade102-2bb2-44ff-8300-ba6d24d71a03 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1450 microversion: 2.1 time: 0.161832 Oct 28 08:50:05.022545 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 654/1255] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:04 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:05.057515 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8a584719-7d58-4d20-88ed-c8a2708fb219 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:05.058464 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8a584719-7d58-4d20-88ed-c8a2708fb219 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:05.065130 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a584719-7d58-4d20-88ed-c8a2708fb219 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:05.065580 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a584719-7d58-4d20-88ed-c8a2708fb219 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:05.066445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a584719-7d58-4d20-88ed-c8a2708fb219 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:05.066888 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a584719-7d58-4d20-88ed-c8a2708fb219 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:05.071432 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ab0dc247-70de-4549-bab8-4f43f53b95ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:05.072573 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ab0dc247-70de-4549-bab8-4f43f53b95ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:05.078348 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab0dc247-70de-4549-bab8-4f43f53b95ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:05.078788 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab0dc247-70de-4549-bab8-4f43f53b95ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:05.079551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab0dc247-70de-4549-bab8-4f43f53b95ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:05.079982 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ab0dc247-70de-4549-bab8-4f43f53b95ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:05.183659 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8a584719-7d58-4d20-88ed-c8a2708fb219 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 38216 microversion: 2.20 time: 0.129606 Oct 28 08:50:05.185064 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 602/1256] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:50:05 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 38216 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:05.202891 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ab0dc247-70de-4549-bab8-4f43f53b95ed tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 38309 microversion: 2.1 time: 0.134984 Oct 28 08:50:05.203699 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 655/1257] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:05 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 38309 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:50:06.196421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bd274a89-2121-4d31-8c48-a506b9fbf981 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:06.197444 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bd274a89-2121-4d31-8c48-a506b9fbf981 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:06.204917 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bd274a89-2121-4d31-8c48-a506b9fbf981 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:06.205707 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bd274a89-2121-4d31-8c48-a506b9fbf981 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:06.206717 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bd274a89-2121-4d31-8c48-a506b9fbf981 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:06.207345 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bd274a89-2121-4d31-8c48-a506b9fbf981 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:06.216159 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d7841e39-34a3-4f37-b943-125bdd5cd3ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:06.217184 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d7841e39-34a3-4f37-b943-125bdd5cd3ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:06.234487 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7841e39-34a3-4f37-b943-125bdd5cd3ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:06.234941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7841e39-34a3-4f37-b943-125bdd5cd3ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:06.235793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7841e39-34a3-4f37-b943-125bdd5cd3ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:06.236377 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d7841e39-34a3-4f37-b943-125bdd5cd3ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:06.279271 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bd274a89-2121-4d31-8c48-a506b9fbf981 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 38216 microversion: 2.20 time: 0.087017 Oct 28 08:50:06.282025 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 603/1258] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:50:06 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 38216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:06.317620 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d7841e39-34a3-4f37-b943-125bdd5cd3ef tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 38309 microversion: 2.1 time: 0.105133 Oct 28 08:50:06.338828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 656/1259] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:06 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 38309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:50:06.846907 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-bafba142-a75d-45d8-a31f-99446cdbb484 req-9d8f1b48-c5cb-4ad3-8cc3-234e44c7b24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98", "tag": "58fe07ec-e0d5-48c7-a254-bcaf6285fb85"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:06.848563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:50:06.848563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:50:06.856785 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-bafba142-a75d-45d8-a31f-99446cdbb484 req-9d8f1b48-c5cb-4ad3-8cc3-234e44c7b24f service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:06.857226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-bafba142-a75d-45d8-a31f-99446cdbb484 req-9d8f1b48-c5cb-4ad3-8cc3-234e44c7b24f service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:06.870861 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-bafba142-a75d-45d8-a31f-99446cdbb484 req-9d8f1b48-c5cb-4ad3-8cc3-234e44c7b24f service nova] Creating event network-changed:58fe07ec-e0d5-48c7-a254-bcaf6285fb85 for instance dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 on hv-cinder-81566 Oct 28 08:50:06.875691 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-bafba142-a75d-45d8-a31f-99446cdbb484 req-9d8f1b48-c5cb-4ad3-8cc3-234e44c7b24f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032910 Oct 28 08:50:06.876551 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 604/1260] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:50:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:07.292353 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d968ce6c-358b-4f0c-b475-8be6025b0c20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:07.293545 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d968ce6c-358b-4f0c-b475-8be6025b0c20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:07.304043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d968ce6c-358b-4f0c-b475-8be6025b0c20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:07.304043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d968ce6c-358b-4f0c-b475-8be6025b0c20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:07.304043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d968ce6c-358b-4f0c-b475-8be6025b0c20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:07.304043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d968ce6c-358b-4f0c-b475-8be6025b0c20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:07.347542 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e2413f67-d6cf-484b-b847-232612f494f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:07.348589 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e2413f67-d6cf-484b-b847-232612f494f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:07.361871 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2413f67-d6cf-484b-b847-232612f494f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:07.362353 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2413f67-d6cf-484b-b847-232612f494f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:07.363195 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2413f67-d6cf-484b-b847-232612f494f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:07.363705 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2413f67-d6cf-484b-b847-232612f494f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:07.375779 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d968ce6c-358b-4f0c-b475-8be6025b0c20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 38216 microversion: 2.20 time: 0.087812 Oct 28 08:50:07.377347 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 657/1261] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:50:07 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 38216 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:07.434883 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e2413f67-d6cf-484b-b847-232612f494f5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 38309 microversion: 2.1 time: 0.091708 Oct 28 08:50:07.435649 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 605/1262] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:07 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 38309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:50:08.389378 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b85dcb15-6a37-4f3f-9e1a-06821432d879 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:08.390555 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b85dcb15-6a37-4f3f-9e1a-06821432d879 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:08.398355 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b85dcb15-6a37-4f3f-9e1a-06821432d879 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:08.398841 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b85dcb15-6a37-4f3f-9e1a-06821432d879 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:08.399677 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b85dcb15-6a37-4f3f-9e1a-06821432d879 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:08.400152 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b85dcb15-6a37-4f3f-9e1a-06821432d879 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:08.447632 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5cde9597-773f-4145-8e67-b44ee4c306c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:08.448633 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5cde9597-773f-4145-8e67-b44ee4c306c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:08.455788 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5cde9597-773f-4145-8e67-b44ee4c306c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:08.456229 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5cde9597-773f-4145-8e67-b44ee4c306c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:08.457027 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5cde9597-773f-4145-8e67-b44ee4c306c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:08.457463 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5cde9597-773f-4145-8e67-b44ee4c306c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:08.472114 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b85dcb15-6a37-4f3f-9e1a-06821432d879 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 38216 microversion: 2.20 time: 0.086732 Oct 28 08:50:08.473068 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 658/1263] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:50:08 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 38216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:50:08.522789 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5cde9597-773f-4145-8e67-b44ee4c306c2 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 38309 microversion: 2.1 time: 0.079017 Oct 28 08:50:08.523445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 606/1264] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:08 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 38309 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:50:09.485219 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e05eba46-ebc1-4c14-9e0f-05e0efa1fcd3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:09.486230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e05eba46-ebc1-4c14-9e0f-05e0efa1fcd3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:09.493755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e05eba46-ebc1-4c14-9e0f-05e0efa1fcd3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:09.494219 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e05eba46-ebc1-4c14-9e0f-05e0efa1fcd3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:09.494973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e05eba46-ebc1-4c14-9e0f-05e0efa1fcd3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:09.495397 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e05eba46-ebc1-4c14-9e0f-05e0efa1fcd3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:09.535310 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-93628e1b-df79-478f-9ace-a4b13553a271 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:09.536305 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-93628e1b-df79-478f-9ace-a4b13553a271 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:09.543365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93628e1b-df79-478f-9ace-a4b13553a271 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:09.543807 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93628e1b-df79-478f-9ace-a4b13553a271 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:09.544565 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93628e1b-df79-478f-9ace-a4b13553a271 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:09.544994 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-93628e1b-df79-478f-9ace-a4b13553a271 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:09.576150 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e05eba46-ebc1-4c14-9e0f-05e0efa1fcd3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 200 len: 38359 microversion: 2.20 time: 0.094846 Oct 28 08:50:09.577245 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 659/1265] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:50:09 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 38359 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:09.587582 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-19426c81-fb58-4ad1-91db-968eeeadec77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:09.588160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-19426c81-fb58-4ad1-91db-968eeeadec77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:09.595219 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-19426c81-fb58-4ad1-91db-968eeeadec77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:09.595661 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-19426c81-fb58-4ad1-91db-968eeeadec77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:09.596418 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-19426c81-fb58-4ad1-91db-968eeeadec77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:09.596847 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-19426c81-fb58-4ad1-91db-968eeeadec77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:09.615004 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-93628e1b-df79-478f-9ace-a4b13553a271 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 38309 microversion: 2.1 time: 0.082352 Oct 28 08:50:09.615004 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 607/1266] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:09 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 38309 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:50:09.625766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-19426c81-fb58-4ad1-91db-968eeeadec77 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/ips" status: 200 len: 151 microversion: 2.20 time: 0.042219 Oct 28 08:50:09.626397 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 660/1267] 10.222.0.74 () {60 vars in 1288 bytes} [Thu Oct 28 08:50:09 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:50:10.627122 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-03619765-65d7-40c8-bbb1-af0d43618b5a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:10.628128 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-03619765-65d7-40c8-bbb1-af0d43618b5a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:10.635554 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-03619765-65d7-40c8-bbb1-af0d43618b5a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:10.636010 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-03619765-65d7-40c8-bbb1-af0d43618b5a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:10.636787 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-03619765-65d7-40c8-bbb1-af0d43618b5a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:10.637225 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-03619765-65d7-40c8-bbb1-af0d43618b5a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:10.731273 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-03619765-65d7-40c8-bbb1-af0d43618b5a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action" status: 200 len: 38440 microversion: 2.1 time: 0.107997 Oct 28 08:50:10.731840 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 608/1268] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:10 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/action => generated 38440 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:50:10.742883 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-80fbe8f9-8f30-4d3a-8bb3-a5a83478a695 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:10.743433 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-80fbe8f9-8f30-4d3a-8bb3-a5a83478a695 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:10.752286 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80fbe8f9-8f30-4d3a-8bb3-a5a83478a695 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:10.752971 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80fbe8f9-8f30-4d3a-8bb3-a5a83478a695 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:10.754122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80fbe8f9-8f30-4d3a-8bb3-a5a83478a695 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:10.755160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-80fbe8f9-8f30-4d3a-8bb3-a5a83478a695 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:10.781506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-80fbe8f9-8f30-4d3a-8bb3-a5a83478a695 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/ips" status: 200 len: 145 microversion: 2.1 time: 0.043154 Oct 28 08:50:10.782122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 661/1269] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Oct 28 08:50:10 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:12.088794 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-91d74eb4-6790-4109-9c0f-4209b2ee04bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:12.089518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-91d74eb4-6790-4109-9c0f-4209b2ee04bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:12.096081 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-91d74eb4-6790-4109-9c0f-4209b2ee04bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:12.096725 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-91d74eb4-6790-4109-9c0f-4209b2ee04bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:12.097539 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-91d74eb4-6790-4109-9c0f-4209b2ee04bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:12.098031 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-91d74eb4-6790-4109-9c0f-4209b2ee04bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:12.112255 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-441b6382-900e-40e3-9c15-67687fd81efd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9b5e85e-d21a-4e9a-b8fb-5a1ddad3c5af"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:12.113342 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-441b6382-900e-40e3-9c15-67687fd81efd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:12.120175 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-441b6382-900e-40e3-9c15-67687fd81efd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:12.120646 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-441b6382-900e-40e3-9c15-67687fd81efd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:12.121419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-441b6382-900e-40e3-9c15-67687fd81efd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:12.121860 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-441b6382-900e-40e3-9c15-67687fd81efd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:12.124954 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.objects.instance [None req-91d74eb4-6790-4109-9c0f-4209b2ee04bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lazy-loading 'flavor' on Instance uuid 44471d5a-b894-4e3f-b59d-b03afd03839b {{(pid=132796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:50:12.375200 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-441b6382-900e-40e3-9c15-67687fd81efd tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266499 Oct 28 08:50:12.376440 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 662/1270] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:50:12 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:50:12.421688 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-91d74eb4-6790-4109-9c0f-4209b2ee04bb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 202 len: 0 microversion: 2.20 time: 0.336369 Oct 28 08:50:12.422549 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 609/1271] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:50:12 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:50:12.440012 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2acbc05b-c9bf-4e5d-9ad1-49edfe788900 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:12.440934 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2acbc05b-c9bf-4e5d-9ad1-49edfe788900 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:12.449083 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2acbc05b-c9bf-4e5d-9ad1-49edfe788900 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:12.449568 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2acbc05b-c9bf-4e5d-9ad1-49edfe788900 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:12.450448 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2acbc05b-c9bf-4e5d-9ad1-49edfe788900 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:12.450930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2acbc05b-c9bf-4e5d-9ad1-49edfe788900 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:12.589384 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2acbc05b-c9bf-4e5d-9ad1-49edfe788900 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:12.597828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2acbc05b-c9bf-4e5d-9ad1-49edfe788900 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:12.600506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2acbc05b-c9bf-4e5d-9ad1-49edfe788900 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:12.601722 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2acbc05b-c9bf-4e5d-9ad1-49edfe788900 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.173910 Oct 28 08:50:12.602305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 663/1272] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:12 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:13.621869 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1874ec52-4c00-4c96-af62-3360587e08de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:13.622565 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1874ec52-4c00-4c96-af62-3360587e08de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:13.628835 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1874ec52-4c00-4c96-af62-3360587e08de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:13.629282 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1874ec52-4c00-4c96-af62-3360587e08de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:13.630239 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1874ec52-4c00-4c96-af62-3360587e08de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:13.630676 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1874ec52-4c00-4c96-af62-3360587e08de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:13.757617 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1874ec52-4c00-4c96-af62-3360587e08de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:13.765393 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1874ec52-4c00-4c96-af62-3360587e08de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:13.767024 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1874ec52-4c00-4c96-af62-3360587e08de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:13.768212 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1874ec52-4c00-4c96-af62-3360587e08de tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.151064 Oct 28 08:50:13.768780 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 610/1273] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:13 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:14.786801 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9db0ab54-9bce-4f69-aa03-a0bc3b3af7f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:14.787400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9db0ab54-9bce-4f69-aa03-a0bc3b3af7f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:14.794220 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9db0ab54-9bce-4f69-aa03-a0bc3b3af7f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:14.794671 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9db0ab54-9bce-4f69-aa03-a0bc3b3af7f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:14.795447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9db0ab54-9bce-4f69-aa03-a0bc3b3af7f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:14.795881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9db0ab54-9bce-4f69-aa03-a0bc3b3af7f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:14.925732 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9db0ab54-9bce-4f69-aa03-a0bc3b3af7f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:14.934829 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9db0ab54-9bce-4f69-aa03-a0bc3b3af7f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:14.936315 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9db0ab54-9bce-4f69-aa03-a0bc3b3af7f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:14.937484 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9db0ab54-9bce-4f69-aa03-a0bc3b3af7f8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.154683 Oct 28 08:50:14.938080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 664/1274] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:14 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:15.955809 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9d234a2d-1ca1-4643-8f85-8279cbb55143 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:15.956347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9d234a2d-1ca1-4643-8f85-8279cbb55143 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:15.963569 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d234a2d-1ca1-4643-8f85-8279cbb55143 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:15.964015 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d234a2d-1ca1-4643-8f85-8279cbb55143 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:15.964782 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d234a2d-1ca1-4643-8f85-8279cbb55143 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:15.965217 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9d234a2d-1ca1-4643-8f85-8279cbb55143 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:16.099927 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9d234a2d-1ca1-4643-8f85-8279cbb55143 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:16.107574 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9d234a2d-1ca1-4643-8f85-8279cbb55143 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:16.109077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9d234a2d-1ca1-4643-8f85-8279cbb55143 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:16.110294 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9d234a2d-1ca1-4643-8f85-8279cbb55143 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.158424 Oct 28 08:50:16.110861 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 611/1275] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:15 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:17.129061 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0f040ec7-5ada-4c8c-bdb3-3508076849a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:17.129937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0f040ec7-5ada-4c8c-bdb3-3508076849a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:17.136660 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f040ec7-5ada-4c8c-bdb3-3508076849a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:17.137104 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f040ec7-5ada-4c8c-bdb3-3508076849a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:17.137919 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f040ec7-5ada-4c8c-bdb3-3508076849a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:17.138385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0f040ec7-5ada-4c8c-bdb3-3508076849a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:17.268018 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0f040ec7-5ada-4c8c-bdb3-3508076849a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:17.276690 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0f040ec7-5ada-4c8c-bdb3-3508076849a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:17.278215 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0f040ec7-5ada-4c8c-bdb3-3508076849a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:17.279381 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0f040ec7-5ada-4c8c-bdb3-3508076849a0 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.154240 Oct 28 08:50:17.279946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 665/1276] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:17 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:18.297766 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8a314ee0-481a-4184-bc12-b6abf54e3280 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:18.298395 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8a314ee0-481a-4184-bc12-b6abf54e3280 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:18.304921 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a314ee0-481a-4184-bc12-b6abf54e3280 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:18.305372 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a314ee0-481a-4184-bc12-b6abf54e3280 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:18.306174 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a314ee0-481a-4184-bc12-b6abf54e3280 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:18.306611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8a314ee0-481a-4184-bc12-b6abf54e3280 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:18.431311 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8a314ee0-481a-4184-bc12-b6abf54e3280 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:18.441704 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8a314ee0-481a-4184-bc12-b6abf54e3280 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:18.443821 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8a314ee0-481a-4184-bc12-b6abf54e3280 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:18.445000 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8a314ee0-481a-4184-bc12-b6abf54e3280 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.150981 Oct 28 08:50:18.445556 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 612/1277] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:18 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:19.463872 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c6fcc57e-79a9-4eba-9a02-2d4df62367a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:19.464408 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c6fcc57e-79a9-4eba-9a02-2d4df62367a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:19.470743 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6fcc57e-79a9-4eba-9a02-2d4df62367a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:19.471188 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6fcc57e-79a9-4eba-9a02-2d4df62367a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:19.471966 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6fcc57e-79a9-4eba-9a02-2d4df62367a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:19.472400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6fcc57e-79a9-4eba-9a02-2d4df62367a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:19.604020 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c6fcc57e-79a9-4eba-9a02-2d4df62367a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:19.613733 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c6fcc57e-79a9-4eba-9a02-2d4df62367a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:19.616115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c6fcc57e-79a9-4eba-9a02-2d4df62367a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:19.617279 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c6fcc57e-79a9-4eba-9a02-2d4df62367a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.157494 Oct 28 08:50:19.617850 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 666/1278] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:19 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:19.901575 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fda32c3f-1a21-46c2-971d-459b38beace5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:19.902602 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fda32c3f-1a21-46c2-971d-459b38beace5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:19.909394 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fda32c3f-1a21-46c2-971d-459b38beace5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:19.909955 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fda32c3f-1a21-46c2-971d-459b38beace5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:19.910725 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fda32c3f-1a21-46c2-971d-459b38beace5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:19.912465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fda32c3f-1a21-46c2-971d-459b38beace5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:19.943599 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fda32c3f-1a21-46c2-971d-459b38beace5 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Oct 28 08:50:19.944164 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 613/1279] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:50:19 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:19.953846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d031e2cf-712b-4858-965a-cb5106f2331a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:19.954338 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d031e2cf-712b-4858-965a-cb5106f2331a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:19.961286 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d031e2cf-712b-4858-965a-cb5106f2331a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:19.961739 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d031e2cf-712b-4858-965a-cb5106f2331a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:19.962592 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d031e2cf-712b-4858-965a-cb5106f2331a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:19.963025 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d031e2cf-712b-4858-965a-cb5106f2331a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:19.993556 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d031e2cf-712b-4858-965a-cb5106f2331a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments/f9b5e85e-d21a-4e9a-b8fb-5a1ddad3c5af" status: 200 len: 194 microversion: 2.1 time: 0.043415 Oct 28 08:50:19.994190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 667/1280] 10.222.0.74 () {58 vars in 1412 bytes} [Thu Oct 28 08:50:19 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments/f9b5e85e-d21a-4e9a-b8fb-5a1ddad3c5af => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:20.634990 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a0bcd259-3e6d-46b8-8072-acdcfe990299 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:20.635579 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a0bcd259-3e6d-46b8-8072-acdcfe990299 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:20.641810 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a0bcd259-3e6d-46b8-8072-acdcfe990299 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:20.642256 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a0bcd259-3e6d-46b8-8072-acdcfe990299 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:20.643036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a0bcd259-3e6d-46b8-8072-acdcfe990299 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:20.643465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a0bcd259-3e6d-46b8-8072-acdcfe990299 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:20.775762 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a0bcd259-3e6d-46b8-8072-acdcfe990299 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:20.783875 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a0bcd259-3e6d-46b8-8072-acdcfe990299 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:20.785369 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a0bcd259-3e6d-46b8-8072-acdcfe990299 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:20.787253 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a0bcd259-3e6d-46b8-8072-acdcfe990299 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.155983 Oct 28 08:50:20.787816 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 614/1281] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:20 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:21.315438 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-cec64969-3b0b-4020-93f2-d10820933a77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a077467-970d-4e19-94eb-72412c56ee9a"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:21.316564 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-cec64969-3b0b-4020-93f2-d10820933a77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:21.323918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cec64969-3b0b-4020-93f2-d10820933a77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:21.324362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cec64969-3b0b-4020-93f2-d10820933a77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:21.325134 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cec64969-3b0b-4020-93f2-d10820933a77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:21.325562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cec64969-3b0b-4020-93f2-d10820933a77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:21.594924 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-cec64969-3b0b-4020-93f2-d10820933a77 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283259 Oct 28 08:50:21.596228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 668/1282] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:50:21 2021] POST /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:21.805558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6963c404-7cd9-41ee-a4d6-6c55f20fa5ab tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:21.806204 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6963c404-7cd9-41ee-a4d6-6c55f20fa5ab tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:21.812229 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6963c404-7cd9-41ee-a4d6-6c55f20fa5ab tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:21.812680 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6963c404-7cd9-41ee-a4d6-6c55f20fa5ab tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:21.813451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6963c404-7cd9-41ee-a4d6-6c55f20fa5ab tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:21.813934 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6963c404-7cd9-41ee-a4d6-6c55f20fa5ab tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:21.945930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6963c404-7cd9-41ee-a4d6-6c55f20fa5ab tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:21.954323 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6963c404-7cd9-41ee-a4d6-6c55f20fa5ab tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:21.955837 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6963c404-7cd9-41ee-a4d6-6c55f20fa5ab tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:21.956983 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6963c404-7cd9-41ee-a4d6-6c55f20fa5ab tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.155726 Oct 28 08:50:21.957535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 615/1283] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:21 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:22.977599 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f85c8e9f-8392-4f36-8dcf-122b72ec5897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:22.978224 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f85c8e9f-8392-4f36-8dcf-122b72ec5897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:22.984375 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f85c8e9f-8392-4f36-8dcf-122b72ec5897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:22.984891 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f85c8e9f-8392-4f36-8dcf-122b72ec5897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:22.985766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f85c8e9f-8392-4f36-8dcf-122b72ec5897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:22.986237 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f85c8e9f-8392-4f36-8dcf-122b72ec5897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:23.115221 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f85c8e9f-8392-4f36-8dcf-122b72ec5897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:23.123774 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f85c8e9f-8392-4f36-8dcf-122b72ec5897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:23.125375 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f85c8e9f-8392-4f36-8dcf-122b72ec5897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:23.126603 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f85c8e9f-8392-4f36-8dcf-122b72ec5897 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.154509 Oct 28 08:50:23.127201 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 669/1284] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:22 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:24.146184 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a9333882-5b2e-4431-a7cc-8aab9905324a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:24.147351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a9333882-5b2e-4431-a7cc-8aab9905324a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:24.153892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a9333882-5b2e-4431-a7cc-8aab9905324a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:24.155443 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a9333882-5b2e-4431-a7cc-8aab9905324a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:24.155443 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a9333882-5b2e-4431-a7cc-8aab9905324a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:24.155665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a9333882-5b2e-4431-a7cc-8aab9905324a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:24.280254 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a9333882-5b2e-4431-a7cc-8aab9905324a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:24.289822 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a9333882-5b2e-4431-a7cc-8aab9905324a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:24.291378 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a9333882-5b2e-4431-a7cc-8aab9905324a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:24.292584 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a9333882-5b2e-4431-a7cc-8aab9905324a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.150887 Oct 28 08:50:24.293148 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 616/1285] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:24 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:25.310655 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d5194c22-1658-4110-b211-4199d1e3844f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:25.311254 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d5194c22-1658-4110-b211-4199d1e3844f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:25.317758 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5194c22-1658-4110-b211-4199d1e3844f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:25.318327 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5194c22-1658-4110-b211-4199d1e3844f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:25.319096 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5194c22-1658-4110-b211-4199d1e3844f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:25.319525 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5194c22-1658-4110-b211-4199d1e3844f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:25.460317 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d5194c22-1658-4110-b211-4199d1e3844f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:25.469657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d5194c22-1658-4110-b211-4199d1e3844f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:25.471285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d5194c22-1658-4110-b211-4199d1e3844f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:25.472589 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d5194c22-1658-4110-b211-4199d1e3844f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.165625 Oct 28 08:50:25.473186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 670/1286] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:25 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:26.494439 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-893f5f3e-bade-47f3-8e61-36c964b3d77f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:26.494992 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-893f5f3e-bade-47f3-8e61-36c964b3d77f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:26.501173 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-893f5f3e-bade-47f3-8e61-36c964b3d77f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:26.501618 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-893f5f3e-bade-47f3-8e61-36c964b3d77f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:26.502421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-893f5f3e-bade-47f3-8e61-36c964b3d77f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:26.502857 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-893f5f3e-bade-47f3-8e61-36c964b3d77f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:26.631682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-893f5f3e-bade-47f3-8e61-36c964b3d77f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:26.640675 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-893f5f3e-bade-47f3-8e61-36c964b3d77f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:26.642197 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-893f5f3e-bade-47f3-8e61-36c964b3d77f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:26.643379 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-893f5f3e-bade-47f3-8e61-36c964b3d77f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.152900 Oct 28 08:50:26.643937 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 617/1287] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:26 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:27.661885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-95738030-0fff-4413-8eb1-ceecbbc3f063 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:27.662462 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-95738030-0fff-4413-8eb1-ceecbbc3f063 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:27.669163 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95738030-0fff-4413-8eb1-ceecbbc3f063 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:27.669606 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95738030-0fff-4413-8eb1-ceecbbc3f063 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:27.670392 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95738030-0fff-4413-8eb1-ceecbbc3f063 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:27.670870 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95738030-0fff-4413-8eb1-ceecbbc3f063 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:27.809618 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-95738030-0fff-4413-8eb1-ceecbbc3f063 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:27.818998 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-95738030-0fff-4413-8eb1-ceecbbc3f063 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:27.820821 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-95738030-0fff-4413-8eb1-ceecbbc3f063 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:27.822020 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-95738030-0fff-4413-8eb1-ceecbbc3f063 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.164623 Oct 28 08:50:27.822572 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 671/1288] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:27 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:28.840444 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e2a37233-2180-4829-98de-fdc0eebf2c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:28.841052 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e2a37233-2180-4829-98de-fdc0eebf2c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:28.847881 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2a37233-2180-4829-98de-fdc0eebf2c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:28.848216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2a37233-2180-4829-98de-fdc0eebf2c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:28.848966 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2a37233-2180-4829-98de-fdc0eebf2c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:28.849397 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e2a37233-2180-4829-98de-fdc0eebf2c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:28.980086 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e2a37233-2180-4829-98de-fdc0eebf2c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:28.990331 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e2a37233-2180-4829-98de-fdc0eebf2c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:28.991831 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e2a37233-2180-4829-98de-fdc0eebf2c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:28.993008 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e2a37233-2180-4829-98de-fdc0eebf2c9e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.156357 Oct 28 08:50:28.993576 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 618/1289] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:28 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:30.011954 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ae2e769f-f7d8-454f-bdcb-d02c488c84a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:30.012514 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ae2e769f-f7d8-454f-bdcb-d02c488c84a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:30.019148 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae2e769f-f7d8-454f-bdcb-d02c488c84a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.019595 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae2e769f-f7d8-454f-bdcb-d02c488c84a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.020386 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae2e769f-f7d8-454f-bdcb-d02c488c84a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.020830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae2e769f-f7d8-454f-bdcb-d02c488c84a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.128486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-868c7686-07bc-4258-9f5b-f9005d258688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:30.129402 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-868c7686-07bc-4258-9f5b-f9005d258688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:30.136055 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-868c7686-07bc-4258-9f5b-f9005d258688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.136650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-868c7686-07bc-4258-9f5b-f9005d258688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.137439 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-868c7686-07bc-4258-9f5b-f9005d258688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.137899 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-868c7686-07bc-4258-9f5b-f9005d258688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.156791 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ae2e769f-f7d8-454f-bdcb-d02c488c84a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:30.165600 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ae2e769f-f7d8-454f-bdcb-d02c488c84a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:30.167256 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ae2e769f-f7d8-454f-bdcb-d02c488c84a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:30.168497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ae2e769f-f7d8-454f-bdcb-d02c488c84a8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1743 microversion: 2.20 time: 0.160547 Oct 28 08:50:30.168662 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-868c7686-07bc-4258-9f5b-f9005d258688 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043899 Oct 28 08:50:30.169506 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 619/1291] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:50:30 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:50:30.169675 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 672/1291] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:30 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:30.563642 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e4e0616b-08e9-428f-b13f-05dfc8017c93 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:30.564125 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e4e0616b-08e9-428f-b13f-05dfc8017c93 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:30.570792 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e4e0616b-08e9-428f-b13f-05dfc8017c93 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.571234 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e4e0616b-08e9-428f-b13f-05dfc8017c93 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.571995 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e4e0616b-08e9-428f-b13f-05dfc8017c93 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.572421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e4e0616b-08e9-428f-b13f-05dfc8017c93 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.603369 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e4e0616b-08e9-428f-b13f-05dfc8017c93 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments/f9b5e85e-d21a-4e9a-b8fb-5a1ddad3c5af" status: 200 len: 194 microversion: 2.1 time: 0.043444 Oct 28 08:50:30.603966 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 620/1292] 10.222.0.74 () {58 vars in 1412 bytes} [Thu Oct 28 08:50:30 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments/f9b5e85e-d21a-4e9a-b8fb-5a1ddad3c5af => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:30.613903 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1ee7bfae-87e0-48f0-a1f9-f04db0db851c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:30.614705 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1ee7bfae-87e0-48f0-a1f9-f04db0db851c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:30.620391 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ee7bfae-87e0-48f0-a1f9-f04db0db851c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.620830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ee7bfae-87e0-48f0-a1f9-f04db0db851c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.621601 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ee7bfae-87e0-48f0-a1f9-f04db0db851c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.622064 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1ee7bfae-87e0-48f0-a1f9-f04db0db851c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.704251 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-1ee7bfae-87e0-48f0-a1f9-f04db0db851c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lazy-loading 'services' on Instance uuid 60d4d877-fc9e-4f25-a21c-219f08ecdcff {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:50:30.776428 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1ee7bfae-87e0-48f0-a1f9-f04db0db851c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "DELETE /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments/f9b5e85e-d21a-4e9a-b8fb-5a1ddad3c5af" status: 202 len: 0 microversion: 2.1 time: 0.166184 Oct 28 08:50:30.777037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 673/1293] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:50:30 2021] DELETE /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments/f9b5e85e-d21a-4e9a-b8fb-5a1ddad3c5af => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:31.187621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-12330ac0-f9a1-4a65-b8dc-02191ae28aa1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:31.188178 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-12330ac0-f9a1-4a65-b8dc-02191ae28aa1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:31.195159 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12330ac0-f9a1-4a65-b8dc-02191ae28aa1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:31.195603 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12330ac0-f9a1-4a65-b8dc-02191ae28aa1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:31.196368 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12330ac0-f9a1-4a65-b8dc-02191ae28aa1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:31.196802 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-12330ac0-f9a1-4a65-b8dc-02191ae28aa1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:31.335979 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-12330ac0-f9a1-4a65-b8dc-02191ae28aa1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:31.343724 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-12330ac0-f9a1-4a65-b8dc-02191ae28aa1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:31.345218 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-12330ac0-f9a1-4a65-b8dc-02191ae28aa1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:31.346423 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-12330ac0-f9a1-4a65-b8dc-02191ae28aa1 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1743 microversion: 2.20 time: 0.162637 Oct 28 08:50:31.346988 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 621/1294] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:31 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:32.368651 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0976c621-fc69-45c9-bdb4-ebc29659cd10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:32.369225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0976c621-fc69-45c9-bdb4-ebc29659cd10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:32.375540 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0976c621-fc69-45c9-bdb4-ebc29659cd10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.375981 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0976c621-fc69-45c9-bdb4-ebc29659cd10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:32.376754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0976c621-fc69-45c9-bdb4-ebc29659cd10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.377186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0976c621-fc69-45c9-bdb4-ebc29659cd10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:32.502137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0976c621-fc69-45c9-bdb4-ebc29659cd10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:32.510495 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0976c621-fc69-45c9-bdb4-ebc29659cd10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:32.511983 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0976c621-fc69-45c9-bdb4-ebc29659cd10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:32.513179 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0976c621-fc69-45c9-bdb4-ebc29659cd10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1743 microversion: 2.20 time: 0.151420 Oct 28 08:50:32.513767 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 674/1295] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:32 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:32.937639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-070ee6b8-cdff-43ea-b5fb-91d8e30a7ac9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:32.938321 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-070ee6b8-cdff-43ea-b5fb-91d8e30a7ac9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:32.945578 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-070ee6b8-cdff-43ea-b5fb-91d8e30a7ac9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.946059 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-070ee6b8-cdff-43ea-b5fb-91d8e30a7ac9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:32.946842 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-070ee6b8-cdff-43ea-b5fb-91d8e30a7ac9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.947275 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-070ee6b8-cdff-43ea-b5fb-91d8e30a7ac9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:32.976057 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-070ee6b8-cdff-43ea-b5fb-91d8e30a7ac9 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments/4a077467-970d-4e19-94eb-72412c56ee9a" status: 200 len: 194 microversion: 2.1 time: 0.042323 Oct 28 08:50:32.976634 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 622/1296] 10.222.0.74 () {58 vars in 1412 bytes} [Thu Oct 28 08:50:32 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments/4a077467-970d-4e19-94eb-72412c56ee9a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:32.986211 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e8f41a85-3169-406d-8f06-9f93eb12665d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:32.986709 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e8f41a85-3169-406d-8f06-9f93eb12665d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:32.994043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e8f41a85-3169-406d-8f06-9f93eb12665d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.994497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e8f41a85-3169-406d-8f06-9f93eb12665d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:32.995286 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e8f41a85-3169-406d-8f06-9f93eb12665d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.995725 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e8f41a85-3169-406d-8f06-9f93eb12665d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:33.078921 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-e8f41a85-3169-406d-8f06-9f93eb12665d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lazy-loading 'services' on Instance uuid 60d4d877-fc9e-4f25-a21c-219f08ecdcff {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:50:33.156455 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e8f41a85-3169-406d-8f06-9f93eb12665d tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "DELETE /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments/4a077467-970d-4e19-94eb-72412c56ee9a" status: 202 len: 0 microversion: 2.1 time: 0.173577 Oct 28 08:50:33.157146 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 675/1297] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:50:32 2021] DELETE /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments/4a077467-970d-4e19-94eb-72412c56ee9a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:33.538028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3154c67e-abe9-4fa8-83e5-15e333486d60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:33.539204 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3154c67e-abe9-4fa8-83e5-15e333486d60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:33.547010 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3154c67e-abe9-4fa8-83e5-15e333486d60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:33.547459 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3154c67e-abe9-4fa8-83e5-15e333486d60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:33.548295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3154c67e-abe9-4fa8-83e5-15e333486d60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:33.548678 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3154c67e-abe9-4fa8-83e5-15e333486d60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:33.594216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-aaaa1252-0f22-4fd0-8be8-89fed58093ce req-198030ef-fe4e-49cb-9e96-ede4ad3ccdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44471d5a-b894-4e3f-b59d-b03afd03839b", "name": "network-vif-plugged", "status": "completed", "tag": "21594cc8-c73a-42e8-9350-519f7620496e"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:33.595734 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:50:33.595734 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:50:33.603513 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-aaaa1252-0f22-4fd0-8be8-89fed58093ce req-198030ef-fe4e-49cb-9e96-ede4ad3ccdc9 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:33.603963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-aaaa1252-0f22-4fd0-8be8-89fed58093ce req-198030ef-fe4e-49cb-9e96-ede4ad3ccdc9 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:33.616507 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-aaaa1252-0f22-4fd0-8be8-89fed58093ce req-198030ef-fe4e-49cb-9e96-ede4ad3ccdc9 service nova] Creating event network-vif-plugged:21594cc8-c73a-42e8-9350-519f7620496e for instance 44471d5a-b894-4e3f-b59d-b03afd03839b on hv-cinder-81566 Oct 28 08:50:33.621892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-aaaa1252-0f22-4fd0-8be8-89fed58093ce req-198030ef-fe4e-49cb-9e96-ede4ad3ccdc9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096210 Oct 28 08:50:33.622738 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 623/1298] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:50:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:33.690565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3154c67e-abe9-4fa8-83e5-15e333486d60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:33.698871 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3154c67e-abe9-4fa8-83e5-15e333486d60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:33.700365 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3154c67e-abe9-4fa8-83e5-15e333486d60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:33.701518 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3154c67e-abe9-4fa8-83e5-15e333486d60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1743 microversion: 2.20 time: 0.168883 Oct 28 08:50:33.702107 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 676/1299] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:33 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:34.322287 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3f8040a3-4d24-4c20-97b9-3510bb9d5802 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:34.323291 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3f8040a3-4d24-4c20-97b9-3510bb9d5802 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:34.329422 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f8040a3-4d24-4c20-97b9-3510bb9d5802 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.329909 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f8040a3-4d24-4c20-97b9-3510bb9d5802 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.330678 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f8040a3-4d24-4c20-97b9-3510bb9d5802 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.331114 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3f8040a3-4d24-4c20-97b9-3510bb9d5802 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.368168 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3f8040a3-4d24-4c20-97b9-3510bb9d5802 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051372 Oct 28 08:50:34.368722 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 624/1300] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:50:34 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:50:34.472697 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-027a6e18-d72f-46e1-8e36-1ad47f416a88 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:34.474586 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-027a6e18-d72f-46e1-8e36-1ad47f416a88 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:34.480174 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-027a6e18-d72f-46e1-8e36-1ad47f416a88 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.480615 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-027a6e18-d72f-46e1-8e36-1ad47f416a88 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.481380 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-027a6e18-d72f-46e1-8e36-1ad47f416a88 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.481829 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-027a6e18-d72f-46e1-8e36-1ad47f416a88 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.518390 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-027a6e18-d72f-46e1-8e36-1ad47f416a88 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049350 Oct 28 08:50:34.518955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 677/1301] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:50:34 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:50:34.575636 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e290bac3-3f71-4eff-a714-a8666e613b19 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:34.576120 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e290bac3-3f71-4eff-a714-a8666e613b19 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:34.581922 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e290bac3-3f71-4eff-a714-a8666e613b19 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.582366 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e290bac3-3f71-4eff-a714-a8666e613b19 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.583613 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e290bac3-3f71-4eff-a714-a8666e613b19 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.584043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e290bac3-3f71-4eff-a714-a8666e613b19 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.608907 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e290bac3-3f71-4eff-a714-a8666e613b19 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:50:34.690237 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e290bac3-3f71-4eff-a714-a8666e613b19 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "DELETE /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 204 len: 0 microversion: 2.1 time: 0.118009 Oct 28 08:50:34.691079 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 625/1302] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:50:34 2021] DELETE /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:50:34.699165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a6f0c72e-a120-45a5-9567-7d92f12cc621 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:34.699773 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a6f0c72e-a120-45a5-9567-7d92f12cc621 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:34.706149 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6f0c72e-a120-45a5-9567-7d92f12cc621 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.706612 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6f0c72e-a120-45a5-9567-7d92f12cc621 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.707397 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6f0c72e-a120-45a5-9567-7d92f12cc621 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.707857 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a6f0c72e-a120-45a5-9567-7d92f12cc621 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.720954 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-61d5ce13-ee73-4781-8b26-8a4f6602c58f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:34.721681 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-61d5ce13-ee73-4781-8b26-8a4f6602c58f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:34.728331 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-61d5ce13-ee73-4781-8b26-8a4f6602c58f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.728781 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-61d5ce13-ee73-4781-8b26-8a4f6602c58f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.729558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-61d5ce13-ee73-4781-8b26-8a4f6602c58f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.730030 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-61d5ce13-ee73-4781-8b26-8a4f6602c58f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.900870 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a6f0c72e-a120-45a5-9567-7d92f12cc621 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:34.905696 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-61d5ce13-ee73-4781-8b26-8a4f6602c58f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:34.908421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a6f0c72e-a120-45a5-9567-7d92f12cc621 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1674 microversion: 2.1 time: 0.212869 Oct 28 08:50:34.909193 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 678/1303] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:34 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1674 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:34.921614 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-61d5ce13-ee73-4781-8b26-8a4f6602c58f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:34.923264 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-61d5ce13-ee73-4781-8b26-8a4f6602c58f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:34.924507 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-61d5ce13-ee73-4781-8b26-8a4f6602c58f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1743 microversion: 2.20 time: 0.207797 Oct 28 08:50:34.925091 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 626/1304] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:34 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1743 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:35.925855 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-947fcf93-b2dc-4b41-9dc1-749caa2d9d4a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:35.926462 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-947fcf93-b2dc-4b41-9dc1-749caa2d9d4a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:35.933530 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-947fcf93-b2dc-4b41-9dc1-749caa2d9d4a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:35.934005 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-947fcf93-b2dc-4b41-9dc1-749caa2d9d4a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:35.934778 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-947fcf93-b2dc-4b41-9dc1-749caa2d9d4a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:35.935216 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-947fcf93-b2dc-4b41-9dc1-749caa2d9d4a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:35.945003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b80c2d48-8c3c-4b5b-8c27-e96b1c4d897d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:35.946067 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b80c2d48-8c3c-4b5b-8c27-e96b1c4d897d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:35.955769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b80c2d48-8c3c-4b5b-8c27-e96b1c4d897d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:35.956214 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b80c2d48-8c3c-4b5b-8c27-e96b1c4d897d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:35.956991 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b80c2d48-8c3c-4b5b-8c27-e96b1c4d897d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:35.957500 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b80c2d48-8c3c-4b5b-8c27-e96b1c4d897d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:36.129037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-947fcf93-b2dc-4b41-9dc1-749caa2d9d4a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:36.131830 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b80c2d48-8c3c-4b5b-8c27-e96b1c4d897d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:36.137141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-947fcf93-b2dc-4b41-9dc1-749caa2d9d4a tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1674 microversion: 2.1 time: 0.214997 Oct 28 08:50:36.137712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 679/1305] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:35 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1674 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:36.139791 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b80c2d48-8c3c-4b5b-8c27-e96b1c4d897d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:36.141321 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b80c2d48-8c3c-4b5b-8c27-e96b1c4d897d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:36.142886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b80c2d48-8c3c-4b5b-8c27-e96b1c4d897d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1743 microversion: 2.20 time: 0.203323 Oct 28 08:50:36.143621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 627/1306] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:35 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:37.154614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b0292bf4-330e-48e8-97fa-86ce3d232228 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:37.155285 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b0292bf4-330e-48e8-97fa-86ce3d232228 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:37.162057 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f7c80f31-f9c5-4fda-b661-3fd1dd6a8adf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:37.163031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b0292bf4-330e-48e8-97fa-86ce3d232228 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:37.163190 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f7c80f31-f9c5-4fda-b661-3fd1dd6a8adf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:37.163335 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b0292bf4-330e-48e8-97fa-86ce3d232228 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:37.164289 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b0292bf4-330e-48e8-97fa-86ce3d232228 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:37.164711 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b0292bf4-330e-48e8-97fa-86ce3d232228 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:37.170624 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7c80f31-f9c5-4fda-b661-3fd1dd6a8adf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:37.171067 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7c80f31-f9c5-4fda-b661-3fd1dd6a8adf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:37.171856 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7c80f31-f9c5-4fda-b661-3fd1dd6a8adf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:37.172285 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f7c80f31-f9c5-4fda-b661-3fd1dd6a8adf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:37.356490 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b0292bf4-330e-48e8-97fa-86ce3d232228 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:37.364552 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b0292bf4-330e-48e8-97fa-86ce3d232228 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1674 microversion: 2.1 time: 0.213067 Oct 28 08:50:37.371008 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f7c80f31-f9c5-4fda-b661-3fd1dd6a8adf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:37.374707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 680/1307] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:37 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:37.379269 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f7c80f31-f9c5-4fda-b661-3fd1dd6a8adf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:37.381439 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f7c80f31-f9c5-4fda-b661-3fd1dd6a8adf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:37.382692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f7c80f31-f9c5-4fda-b661-3fd1dd6a8adf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1743 microversion: 2.20 time: 0.225042 Oct 28 08:50:37.383270 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 628/1308] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:37 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1743 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:38.383262 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-01df1902-d8da-41f3-b1c0-e3cff84405da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:38.385855 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-01df1902-d8da-41f3-b1c0-e3cff84405da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:38.393708 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01df1902-d8da-41f3-b1c0-e3cff84405da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:38.394180 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01df1902-d8da-41f3-b1c0-e3cff84405da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:38.395133 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01df1902-d8da-41f3-b1c0-e3cff84405da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:38.396464 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-01df1902-d8da-41f3-b1c0-e3cff84405da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:38.401394 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-979513f5-110b-4335-b5ea-c3dd8e5838bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:38.402058 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-979513f5-110b-4335-b5ea-c3dd8e5838bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:38.413953 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-979513f5-110b-4335-b5ea-c3dd8e5838bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:38.416270 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-979513f5-110b-4335-b5ea-c3dd8e5838bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:38.417112 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-979513f5-110b-4335-b5ea-c3dd8e5838bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:38.417559 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-979513f5-110b-4335-b5ea-c3dd8e5838bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:38.509745 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-01df1902-d8da-41f3-b1c0-e3cff84405da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '779e2e826df7468d9a84e8f401693d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb9a75c575b487eb97a2f189099cb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:38.540907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-01df1902-d8da-41f3-b1c0-e3cff84405da tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 200 len: 1606 microversion: 2.1 time: 0.162783 Oct 28 08:50:38.542442 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 681/1309] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:38 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 1606 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:38.550321 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-04e67c24-9f6c-486f-8d2f-4233df24a5ab req-c536cd42-2342-4ec8-bc93-1fc0484d2669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d4d877-fc9e-4f25-a21c-219f08ecdcff", "name": "network-vif-deleted", "tag": "0616e940-d1b6-4c1e-b63c-17fc1651dfba"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:38.554401 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:50:38.554401 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:50:38.574750 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-04e67c24-9f6c-486f-8d2f-4233df24a5ab req-c536cd42-2342-4ec8-bc93-1fc0484d2669 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:38.582935 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-04e67c24-9f6c-486f-8d2f-4233df24a5ab req-c536cd42-2342-4ec8-bc93-1fc0484d2669 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:38.598700 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-04e67c24-9f6c-486f-8d2f-4233df24a5ab req-c536cd42-2342-4ec8-bc93-1fc0484d2669 service nova] Creating event network-vif-deleted:0616e940-d1b6-4c1e-b63c-17fc1651dfba for instance 60d4d877-fc9e-4f25-a21c-219f08ecdcff on hv-cinder-81566 Oct 28 08:50:38.610948 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-04e67c24-9f6c-486f-8d2f-4233df24a5ab req-c536cd42-2342-4ec8-bc93-1fc0484d2669 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064481 Oct 28 08:50:38.617970 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 682/1310] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:50:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:38.705734 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-979513f5-110b-4335-b5ea-c3dd8e5838bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:38.714170 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-979513f5-110b-4335-b5ea-c3dd8e5838bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:38.715719 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-979513f5-110b-4335-b5ea-c3dd8e5838bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:38.717228 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-979513f5-110b-4335-b5ea-c3dd8e5838bc tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.319798 Oct 28 08:50:38.718362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 629/1311] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:38 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:39.560355 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7944237e-3c74-4885-9c35-458f9d12ce03 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:39.561339 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7944237e-3c74-4885-9c35-458f9d12ce03 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:39.569522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7944237e-3c74-4885-9c35-458f9d12ce03 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:39.570008 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7944237e-3c74-4885-9c35-458f9d12ce03 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:39.570846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7944237e-3c74-4885-9c35-458f9d12ce03 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:39.571276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7944237e-3c74-4885-9c35-458f9d12ce03 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:39.588694 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-7944237e-3c74-4885-9c35-458f9d12ce03 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] HTTP exception thrown: Instance 60d4d877-fc9e-4f25-a21c-219f08ecdcff could not be found. Oct 28 08:50:39.589295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7944237e-3c74-4885-9c35-458f9d12ce03 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Returning 404 to user: Instance 60d4d877-fc9e-4f25-a21c-219f08ecdcff could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:39.590165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7944237e-3c74-4885-9c35-458f9d12ce03 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 404 len: 111 microversion: 2.1 time: 0.034621 Oct 28 08:50:39.590725 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 683/1312] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:39 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:50:39.599958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-80e4db69-465a-4c56-8f1b-ad495d511e7c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '.version_select at 0x7f9e781aac10>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:39.619852 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-80e4db69-465a-4c56-8f1b-ad495d511e7c tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1457393952" status: 202 len: 0 microversion: 2.1 time: 0.024089 Oct 28 08:50:39.621074 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 630/1313] 10.222.0.74 () {58 vars in 1220 bytes} [Thu Oct 28 08:50:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1457393952 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:39.738101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2b769196-362e-4e68-8317-4e9ae4f98f7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:39.739876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2b769196-362e-4e68-8317-4e9ae4f98f7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:39.750731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2b769196-362e-4e68-8317-4e9ae4f98f7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:39.752526 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2b769196-362e-4e68-8317-4e9ae4f98f7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:39.753552 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2b769196-362e-4e68-8317-4e9ae4f98f7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:39.754242 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2b769196-362e-4e68-8317-4e9ae4f98f7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:39.987305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2b769196-362e-4e68-8317-4e9ae4f98f7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:39.997207 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2b769196-362e-4e68-8317-4e9ae4f98f7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:39.999140 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2b769196-362e-4e68-8317-4e9ae4f98f7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:40.000785 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2b769196-362e-4e68-8317-4e9ae4f98f7c tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.268059 Oct 28 08:50:40.012575 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 684/1314] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:39 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:41.019826 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6a45e507-6d8d-45e3-80d3-280e2ce1561a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:41.021240 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6a45e507-6d8d-45e3-80d3-280e2ce1561a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:41.027950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6a45e507-6d8d-45e3-80d3-280e2ce1561a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:41.028430 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6a45e507-6d8d-45e3-80d3-280e2ce1561a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:41.029341 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6a45e507-6d8d-45e3-80d3-280e2ce1561a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:41.029775 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6a45e507-6d8d-45e3-80d3-280e2ce1561a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:41.183590 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6a45e507-6d8d-45e3-80d3-280e2ce1561a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:41.193014 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6a45e507-6d8d-45e3-80d3-280e2ce1561a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:41.194554 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6a45e507-6d8d-45e3-80d3-280e2ce1561a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:41.195762 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6a45e507-6d8d-45e3-80d3-280e2ce1561a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.180105 Oct 28 08:50:41.196320 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 631/1315] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:41 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:41.266644 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-273d2823-d212-473a-9d76-bcd338f21cc0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:41.267228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-273d2823-d212-473a-9d76-bcd338f21cc0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:41.274589 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-273d2823-d212-473a-9d76-bcd338f21cc0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:41.275033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-273d2823-d212-473a-9d76-bcd338f21cc0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:41.275807 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-273d2823-d212-473a-9d76-bcd338f21cc0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:41.276241 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-273d2823-d212-473a-9d76-bcd338f21cc0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:41.310186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-273d2823-d212-473a-9d76-bcd338f21cc0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lazy-loading 'flavor' on Instance uuid d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:50:41.399082 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-273d2823-d212-473a-9d76-bcd338f21cc0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "POST /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1/action" status: 202 len: 0 microversion: 2.1 time: 0.135952 Oct 28 08:50:41.399679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 685/1316] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:50:41 2021] POST /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:41.407751 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a2a09bb4-1f5b-4d2d-bacd-127f3f1569a4 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:41.408543 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a2a09bb4-1f5b-4d2d-bacd-127f3f1569a4 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:41.415028 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a2a09bb4-1f5b-4d2d-bacd-127f3f1569a4 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:41.415795 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a2a09bb4-1f5b-4d2d-bacd-127f3f1569a4 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:41.416674 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a2a09bb4-1f5b-4d2d-bacd-127f3f1569a4 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:41.417167 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a2a09bb4-1f5b-4d2d-bacd-127f3f1569a4 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:41.572105 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a2a09bb4-1f5b-4d2d-bacd-127f3f1569a4 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:41.580285 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a2a09bb4-1f5b-4d2d-bacd-127f3f1569a4 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.176232 Oct 28 08:50:41.580862 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 632/1317] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:41 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:42.222450 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a675ba96-1f3d-4d94-98f2-21b28228a5aa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:42.224282 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a675ba96-1f3d-4d94-98f2-21b28228a5aa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:42.231371 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a675ba96-1f3d-4d94-98f2-21b28228a5aa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:42.231802 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a675ba96-1f3d-4d94-98f2-21b28228a5aa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:42.232814 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a675ba96-1f3d-4d94-98f2-21b28228a5aa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:42.233421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a675ba96-1f3d-4d94-98f2-21b28228a5aa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:42.373579 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a675ba96-1f3d-4d94-98f2-21b28228a5aa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:42.382147 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a675ba96-1f3d-4d94-98f2-21b28228a5aa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:42.383945 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a675ba96-1f3d-4d94-98f2-21b28228a5aa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:42.385121 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a675ba96-1f3d-4d94-98f2-21b28228a5aa tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.175123 Oct 28 08:50:42.385710 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 686/1318] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:42 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:42.601125 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-479c6cca-4535-448d-8d93-2df2647e1044 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:42.601713 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-479c6cca-4535-448d-8d93-2df2647e1044 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:42.610000 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-479c6cca-4535-448d-8d93-2df2647e1044 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:42.610831 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-479c6cca-4535-448d-8d93-2df2647e1044 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:42.611877 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-479c6cca-4535-448d-8d93-2df2647e1044 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:42.612657 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-479c6cca-4535-448d-8d93-2df2647e1044 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:42.716165 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-87bbc92e-6d1a-4a5f-93d8-94bdeb16c9e1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:42.716822 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-87bbc92e-6d1a-4a5f-93d8-94bdeb16c9e1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:42.723355 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-87bbc92e-6d1a-4a5f-93d8-94bdeb16c9e1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:42.723806 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-87bbc92e-6d1a-4a5f-93d8-94bdeb16c9e1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:42.724608 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-87bbc92e-6d1a-4a5f-93d8-94bdeb16c9e1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:42.725208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-87bbc92e-6d1a-4a5f-93d8-94bdeb16c9e1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:42.741623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-87bbc92e-6d1a-4a5f-93d8-94bdeb16c9e1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] HTTP exception thrown: Instance 60d4d877-fc9e-4f25-a21c-219f08ecdcff could not be found. Oct 28 08:50:42.742453 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-87bbc92e-6d1a-4a5f-93d8-94bdeb16c9e1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Returning 404 to user: Instance 60d4d877-fc9e-4f25-a21c-219f08ecdcff could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:42.743388 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-87bbc92e-6d1a-4a5f-93d8-94bdeb16c9e1 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "DELETE /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 404 len: 111 microversion: 2.1 time: 0.031026 Oct 28 08:50:42.744514 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 687/1319] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:50:42 2021] DELETE /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:50:42.751920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4c9cde5f-2d12-4472-93b2-0c5b06d324d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:42.752556 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4c9cde5f-2d12-4472-93b2-0c5b06d324d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: 60d4d877-fc9e-4f25-a21c-219f08ecdcff] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:42.759119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c9cde5f-2d12-4472-93b2-0c5b06d324d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:42.759569 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c9cde5f-2d12-4472-93b2-0c5b06d324d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:42.760359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c9cde5f-2d12-4472-93b2-0c5b06d324d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:42.760789 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c9cde5f-2d12-4472-93b2-0c5b06d324d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:42.763344 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-479c6cca-4535-448d-8d93-2df2647e1044 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:42.771611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-479c6cca-4535-448d-8d93-2df2647e1044 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.175176 Oct 28 08:50:42.772553 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 633/1320] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:42 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:42.776153 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-4c9cde5f-2d12-4472-93b2-0c5b06d324d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] HTTP exception thrown: Instance 60d4d877-fc9e-4f25-a21c-219f08ecdcff could not be found. Oct 28 08:50:42.777087 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4c9cde5f-2d12-4472-93b2-0c5b06d324d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Returning 404 to user: Instance 60d4d877-fc9e-4f25-a21c-219f08ecdcff could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:42.778181 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4c9cde5f-2d12-4472-93b2-0c5b06d324d6 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff" status: 404 len: 111 microversion: 2.1 time: 0.029884 Oct 28 08:50:42.781815 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 688/1321] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:42 2021] GET /compute/v2.1/servers/60d4d877-fc9e-4f25-a21c-219f08ecdcff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:50:43.404767 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-de595995-bc94-4afa-a2b4-00a1ab7a239a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:43.405371 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-de595995-bc94-4afa-a2b4-00a1ab7a239a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:43.420274 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de595995-bc94-4afa-a2b4-00a1ab7a239a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:43.420728 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de595995-bc94-4afa-a2b4-00a1ab7a239a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:43.421515 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de595995-bc94-4afa-a2b4-00a1ab7a239a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:43.421993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-de595995-bc94-4afa-a2b4-00a1ab7a239a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:43.569280 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-de595995-bc94-4afa-a2b4-00a1ab7a239a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:43.579772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-de595995-bc94-4afa-a2b4-00a1ab7a239a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:43.581825 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-de595995-bc94-4afa-a2b4-00a1ab7a239a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:43.583186 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-de595995-bc94-4afa-a2b4-00a1ab7a239a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.182246 Oct 28 08:50:43.583747 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 634/1322] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:43 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:43.792378 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8cf3f14f-fcc4-4fb4-a76b-1e0fd35f3c4a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:43.794388 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8cf3f14f-fcc4-4fb4-a76b-1e0fd35f3c4a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:43.805182 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8cf3f14f-fcc4-4fb4-a76b-1e0fd35f3c4a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:43.805730 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8cf3f14f-fcc4-4fb4-a76b-1e0fd35f3c4a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:43.806690 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8cf3f14f-fcc4-4fb4-a76b-1e0fd35f3c4a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:43.807400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8cf3f14f-fcc4-4fb4-a76b-1e0fd35f3c4a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:43.942683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8cf3f14f-fcc4-4fb4-a76b-1e0fd35f3c4a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:43.945676 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-546d963a-584c-4eb7-afe3-26c3e3220062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:43.947138 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-546d963a-584c-4eb7-afe3-26c3e3220062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:43.953893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-546d963a-584c-4eb7-afe3-26c3e3220062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:43.954135 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8cf3f14f-fcc4-4fb4-a76b-1e0fd35f3c4a tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.168872 Oct 28 08:50:43.954351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-546d963a-584c-4eb7-afe3-26c3e3220062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:43.954574 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 689/1323] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:43 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:43.955613 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-546d963a-584c-4eb7-afe3-26c3e3220062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:43.956505 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-546d963a-584c-4eb7-afe3-26c3e3220062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:43.975836 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-546d963a-584c-4eb7-afe3-26c3e3220062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] HTTP exception thrown: Instance a8d46e50-0675-4d39-9947-f35acce9f945 could not be found. Oct 28 08:50:43.976893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-546d963a-584c-4eb7-afe3-26c3e3220062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Returning 404 to user: Instance a8d46e50-0675-4d39-9947-f35acce9f945 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:43.977444 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-546d963a-584c-4eb7-afe3-26c3e3220062 tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 404 len: 111 microversion: 2.1 time: 0.035466 Oct 28 08:50:43.981467 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 635/1324] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:50:43 2021] DELETE /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:50:43.986952 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-097e7352-9b8e-47d0-aab9-90d717799f7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:43.988364 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-097e7352-9b8e-47d0-aab9-90d717799f7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] [instance: a8d46e50-0675-4d39-9947-f35acce9f945] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:43.995561 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-097e7352-9b8e-47d0-aab9-90d717799f7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:43.996426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-097e7352-9b8e-47d0-aab9-90d717799f7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:43.997346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-097e7352-9b8e-47d0-aab9-90d717799f7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:43.997933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-097e7352-9b8e-47d0-aab9-90d717799f7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:44.014531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-097e7352-9b8e-47d0-aab9-90d717799f7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] HTTP exception thrown: Instance a8d46e50-0675-4d39-9947-f35acce9f945 could not be found. Oct 28 08:50:44.014531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-097e7352-9b8e-47d0-aab9-90d717799f7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] Returning 404 to user: Instance a8d46e50-0675-4d39-9947-f35acce9f945 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:44.015424 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-097e7352-9b8e-47d0-aab9-90d717799f7f tempest-AttachVolumeTestJSON-328476198 tempest-AttachVolumeTestJSON-328476198-project] 10.222.0.74 "GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945" status: 404 len: 111 microversion: 2.1 time: 0.032343 Oct 28 08:50:44.019784 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 690/1325] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:43 2021] GET /compute/v2.1/servers/a8d46e50-0675-4d39-9947-f35acce9f945 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:50:44.601995 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7ed3239c-a193-440c-ba38-176c9323fbb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:44.602699 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7ed3239c-a193-440c-ba38-176c9323fbb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:44.611265 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7ed3239c-a193-440c-ba38-176c9323fbb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:44.611265 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7ed3239c-a193-440c-ba38-176c9323fbb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:44.611996 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7ed3239c-a193-440c-ba38-176c9323fbb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:44.612440 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7ed3239c-a193-440c-ba38-176c9323fbb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:44.842021 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7ed3239c-a193-440c-ba38-176c9323fbb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:44.854886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7ed3239c-a193-440c-ba38-176c9323fbb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:44.856974 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7ed3239c-a193-440c-ba38-176c9323fbb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:44.858221 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7ed3239c-a193-440c-ba38-176c9323fbb6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.259927 Oct 28 08:50:44.869216 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 636/1326] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:44 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:44.971388 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-177fb09e-25a1-4de6-980c-2e4ee3ddd303 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:44.971997 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-177fb09e-25a1-4de6-980c-2e4ee3ddd303 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:44.986907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-177fb09e-25a1-4de6-980c-2e4ee3ddd303 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:44.987655 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-177fb09e-25a1-4de6-980c-2e4ee3ddd303 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:44.988624 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-177fb09e-25a1-4de6-980c-2e4ee3ddd303 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:44.990141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-177fb09e-25a1-4de6-980c-2e4ee3ddd303 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:45.275282 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-177fb09e-25a1-4de6-980c-2e4ee3ddd303 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:45.283986 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-177fb09e-25a1-4de6-980c-2e4ee3ddd303 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.316163 Oct 28 08:50:45.284579 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 691/1327] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:44 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:45.878618 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-67c32a4d-5bce-40d1-80b4-07284afab24a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:45.879295 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-67c32a4d-5bce-40d1-80b4-07284afab24a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:45.886283 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-67c32a4d-5bce-40d1-80b4-07284afab24a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:45.886996 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-67c32a4d-5bce-40d1-80b4-07284afab24a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:45.887989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-67c32a4d-5bce-40d1-80b4-07284afab24a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:45.888603 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-67c32a4d-5bce-40d1-80b4-07284afab24a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:46.200287 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-67c32a4d-5bce-40d1-80b4-07284afab24a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:46.218442 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-67c32a4d-5bce-40d1-80b4-07284afab24a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:46.219944 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-67c32a4d-5bce-40d1-80b4-07284afab24a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:46.221142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-67c32a4d-5bce-40d1-80b4-07284afab24a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.346406 Oct 28 08:50:46.236840 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 637/1328] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:45 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:46.310538 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6620107d-2d0e-4628-ad85-50081ecc3a76 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:46.311303 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6620107d-2d0e-4628-ad85-50081ecc3a76 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:46.322857 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6620107d-2d0e-4628-ad85-50081ecc3a76 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:46.323684 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6620107d-2d0e-4628-ad85-50081ecc3a76 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:46.324723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6620107d-2d0e-4628-ad85-50081ecc3a76 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:46.325382 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6620107d-2d0e-4628-ad85-50081ecc3a76 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:46.522216 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6620107d-2d0e-4628-ad85-50081ecc3a76 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:46.534136 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6620107d-2d0e-4628-ad85-50081ecc3a76 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.227509 Oct 28 08:50:46.538837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 692/1329] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:46 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:47.244621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0e76126e-a53d-440f-a35a-0e341fc59785 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:47.245902 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0e76126e-a53d-440f-a35a-0e341fc59785 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:47.252416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0e76126e-a53d-440f-a35a-0e341fc59785 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:47.253102 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0e76126e-a53d-440f-a35a-0e341fc59785 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:47.254445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0e76126e-a53d-440f-a35a-0e341fc59785 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:47.255354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0e76126e-a53d-440f-a35a-0e341fc59785 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:47.453769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0e76126e-a53d-440f-a35a-0e341fc59785 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:47.463881 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0e76126e-a53d-440f-a35a-0e341fc59785 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:47.466376 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-0e76126e-a53d-440f-a35a-0e341fc59785 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:47.467918 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0e76126e-a53d-440f-a35a-0e341fc59785 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.228585 Oct 28 08:50:47.469142 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 638/1330] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:47 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:47.552933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e66013ae-e579-4fa5-8d91-1e30a8898eb3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:47.553477 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e66013ae-e579-4fa5-8d91-1e30a8898eb3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:47.561024 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e66013ae-e579-4fa5-8d91-1e30a8898eb3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:47.561450 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e66013ae-e579-4fa5-8d91-1e30a8898eb3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:47.562449 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e66013ae-e579-4fa5-8d91-1e30a8898eb3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:47.562878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e66013ae-e579-4fa5-8d91-1e30a8898eb3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:47.875550 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e66013ae-e579-4fa5-8d91-1e30a8898eb3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:47.892226 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e66013ae-e579-4fa5-8d91-1e30a8898eb3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.343797 Oct 28 08:50:47.892811 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 693/1331] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:47 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:48.489955 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fcb845bf-359b-4683-a9d4-730cee5e909d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:48.490613 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fcb845bf-359b-4683-a9d4-730cee5e909d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:48.497309 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fcb845bf-359b-4683-a9d4-730cee5e909d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:48.497764 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fcb845bf-359b-4683-a9d4-730cee5e909d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:48.498622 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fcb845bf-359b-4683-a9d4-730cee5e909d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:48.499059 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fcb845bf-359b-4683-a9d4-730cee5e909d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:48.666424 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fcb845bf-359b-4683-a9d4-730cee5e909d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:48.676031 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fcb845bf-359b-4683-a9d4-730cee5e909d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:48.678485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fcb845bf-359b-4683-a9d4-730cee5e909d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:48.680279 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fcb845bf-359b-4683-a9d4-730cee5e909d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.195463 Oct 28 08:50:48.680858 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 639/1332] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:48 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:48.915400 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9edfa01d-4cc6-4319-a559-9912cb9eecbe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:48.916831 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9edfa01d-4cc6-4319-a559-9912cb9eecbe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:48.937695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9edfa01d-4cc6-4319-a559-9912cb9eecbe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:48.960667 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9edfa01d-4cc6-4319-a559-9912cb9eecbe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:48.964145 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9edfa01d-4cc6-4319-a559-9912cb9eecbe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:48.964560 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9edfa01d-4cc6-4319-a559-9912cb9eecbe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:49.136846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9edfa01d-4cc6-4319-a559-9912cb9eecbe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:49.147016 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9edfa01d-4cc6-4319-a559-9912cb9eecbe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.234810 Oct 28 08:50:49.149284 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 694/1333] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:48 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:49.714121 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d50f74bf-54f7-4103-a9b9-6c5d128bb687 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:49.716183 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d50f74bf-54f7-4103-a9b9-6c5d128bb687 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:49.736016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d50f74bf-54f7-4103-a9b9-6c5d128bb687 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:49.737111 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d50f74bf-54f7-4103-a9b9-6c5d128bb687 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:49.738934 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d50f74bf-54f7-4103-a9b9-6c5d128bb687 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:49.740807 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d50f74bf-54f7-4103-a9b9-6c5d128bb687 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:49.923226 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d50f74bf-54f7-4103-a9b9-6c5d128bb687 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:49.933655 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d50f74bf-54f7-4103-a9b9-6c5d128bb687 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:49.939485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d50f74bf-54f7-4103-a9b9-6c5d128bb687 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:49.943656 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d50f74bf-54f7-4103-a9b9-6c5d128bb687 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.246964 Oct 28 08:50:49.955518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 640/1334] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:49 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:50.169228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ccbbbdbc-c5d7-471b-8ce7-f32d52272558 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:50.173017 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ccbbbdbc-c5d7-471b-8ce7-f32d52272558 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:50.183731 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ccbbbdbc-c5d7-471b-8ce7-f32d52272558 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:50.184637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ccbbbdbc-c5d7-471b-8ce7-f32d52272558 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:50.185605 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ccbbbdbc-c5d7-471b-8ce7-f32d52272558 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:50.186222 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ccbbbdbc-c5d7-471b-8ce7-f32d52272558 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:50.360916 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ccbbbdbc-c5d7-471b-8ce7-f32d52272558 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:50.373527 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ccbbbdbc-c5d7-471b-8ce7-f32d52272558 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.207936 Oct 28 08:50:50.374728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 695/1335] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:50 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:50.966609 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f0ec7565-b4ce-4eb5-a52d-19770c1a52f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:50.967202 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f0ec7565-b4ce-4eb5-a52d-19770c1a52f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:50.973147 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f0ec7565-b4ce-4eb5-a52d-19770c1a52f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:50.973687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f0ec7565-b4ce-4eb5-a52d-19770c1a52f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:50.974759 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f0ec7565-b4ce-4eb5-a52d-19770c1a52f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:50.975362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f0ec7565-b4ce-4eb5-a52d-19770c1a52f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:51.148982 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f0ec7565-b4ce-4eb5-a52d-19770c1a52f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:51.158487 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f0ec7565-b4ce-4eb5-a52d-19770c1a52f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:51.161033 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f0ec7565-b4ce-4eb5-a52d-19770c1a52f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:51.163087 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f0ec7565-b4ce-4eb5-a52d-19770c1a52f6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.203407 Oct 28 08:50:51.163908 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 641/1336] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:50 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:51.394805 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-12bb071e-8c55-45ac-9d69-c9bec0c4dc85 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:51.395564 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-12bb071e-8c55-45ac-9d69-c9bec0c4dc85 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:51.414631 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-12bb071e-8c55-45ac-9d69-c9bec0c4dc85 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:51.415340 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-12bb071e-8c55-45ac-9d69-c9bec0c4dc85 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:51.416550 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-12bb071e-8c55-45ac-9d69-c9bec0c4dc85 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:51.417557 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-12bb071e-8c55-45ac-9d69-c9bec0c4dc85 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:51.575744 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-12bb071e-8c55-45ac-9d69-c9bec0c4dc85 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:51.586185 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-12bb071e-8c55-45ac-9d69-c9bec0c4dc85 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.195517 Oct 28 08:50:51.586707 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 696/1337] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:51 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:52.184213 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fb24cc1e-d5e9-4419-bebe-3b693eec9f10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:52.185093 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fb24cc1e-d5e9-4419-bebe-3b693eec9f10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:52.195836 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb24cc1e-d5e9-4419-bebe-3b693eec9f10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:52.196277 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb24cc1e-d5e9-4419-bebe-3b693eec9f10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:52.197096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb24cc1e-d5e9-4419-bebe-3b693eec9f10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:52.197614 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fb24cc1e-d5e9-4419-bebe-3b693eec9f10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:52.402984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fb24cc1e-d5e9-4419-bebe-3b693eec9f10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:52.415316 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fb24cc1e-d5e9-4419-bebe-3b693eec9f10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:52.415316 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fb24cc1e-d5e9-4419-bebe-3b693eec9f10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:52.415680 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fb24cc1e-d5e9-4419-bebe-3b693eec9f10 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.236726 Oct 28 08:50:52.418402 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 642/1338] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:52 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:52.605428 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f03b6a76-5fc3-4b7e-8426-fbab3a74b3ff tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:52.606079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f03b6a76-5fc3-4b7e-8426-fbab3a74b3ff tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:52.613209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f03b6a76-5fc3-4b7e-8426-fbab3a74b3ff tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:52.614797 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f03b6a76-5fc3-4b7e-8426-fbab3a74b3ff tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:52.615747 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f03b6a76-5fc3-4b7e-8426-fbab3a74b3ff tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:52.616439 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f03b6a76-5fc3-4b7e-8426-fbab3a74b3ff tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:52.761077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f03b6a76-5fc3-4b7e-8426-fbab3a74b3ff tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:52.768698 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f03b6a76-5fc3-4b7e-8426-fbab3a74b3ff tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.167208 Oct 28 08:50:52.769280 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 697/1339] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:52 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:53.436470 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1e4f35e3-ca1d-474f-a396-3c972bde6198 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:53.437111 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1e4f35e3-ca1d-474f-a396-3c972bde6198 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:53.444158 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e4f35e3-ca1d-474f-a396-3c972bde6198 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:53.444596 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e4f35e3-ca1d-474f-a396-3c972bde6198 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:53.445351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e4f35e3-ca1d-474f-a396-3c972bde6198 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:53.445777 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e4f35e3-ca1d-474f-a396-3c972bde6198 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:53.573052 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1e4f35e3-ca1d-474f-a396-3c972bde6198 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:53.580845 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1e4f35e3-ca1d-474f-a396-3c972bde6198 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:53.582370 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1e4f35e3-ca1d-474f-a396-3c972bde6198 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:53.584229 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1e4f35e3-ca1d-474f-a396-3c972bde6198 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.151480 Oct 28 08:50:53.584819 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 643/1340] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:53 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:53.785834 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-32e1f019-6bfd-4bf8-b3e3-b916effe976e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:53.786944 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-32e1f019-6bfd-4bf8-b3e3-b916effe976e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:53.793506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-32e1f019-6bfd-4bf8-b3e3-b916effe976e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:53.793999 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-32e1f019-6bfd-4bf8-b3e3-b916effe976e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:53.794738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-32e1f019-6bfd-4bf8-b3e3-b916effe976e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:53.795159 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-32e1f019-6bfd-4bf8-b3e3-b916effe976e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:53.917905 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-32e1f019-6bfd-4bf8-b3e3-b916effe976e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:53.926186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-32e1f019-6bfd-4bf8-b3e3-b916effe976e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.143942 Oct 28 08:50:53.927331 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 698/1341] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:53 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:54.602997 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d7495ba7-e00c-43ce-ae16-e920b49edaa3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:54.603609 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d7495ba7-e00c-43ce-ae16-e920b49edaa3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:54.610027 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7495ba7-e00c-43ce-ae16-e920b49edaa3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:54.610479 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7495ba7-e00c-43ce-ae16-e920b49edaa3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:54.611285 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7495ba7-e00c-43ce-ae16-e920b49edaa3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:54.611717 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7495ba7-e00c-43ce-ae16-e920b49edaa3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:54.744649 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d7495ba7-e00c-43ce-ae16-e920b49edaa3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:54.754530 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d7495ba7-e00c-43ce-ae16-e920b49edaa3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:54.757816 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d7495ba7-e00c-43ce-ae16-e920b49edaa3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:54.759741 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d7495ba7-e00c-43ce-ae16-e920b49edaa3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.161021 Oct 28 08:50:54.760481 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 644/1342] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:54 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:54.943835 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a701c87f-b10e-4150-bb63-e9bb2f62bb0d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:54.944454 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a701c87f-b10e-4150-bb63-e9bb2f62bb0d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:54.950793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a701c87f-b10e-4150-bb63-e9bb2f62bb0d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:54.951236 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a701c87f-b10e-4150-bb63-e9bb2f62bb0d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:54.952002 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a701c87f-b10e-4150-bb63-e9bb2f62bb0d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:54.952435 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a701c87f-b10e-4150-bb63-e9bb2f62bb0d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:55.077762 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a701c87f-b10e-4150-bb63-e9bb2f62bb0d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:55.086481 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a701c87f-b10e-4150-bb63-e9bb2f62bb0d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.147220 Oct 28 08:50:55.087044 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 699/1343] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:54 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:55.778055 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-32ff493b-16cc-4503-ba7c-3b8b6c73c530 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:55.778671 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-32ff493b-16cc-4503-ba7c-3b8b6c73c530 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:55.785036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-32ff493b-16cc-4503-ba7c-3b8b6c73c530 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:55.785481 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-32ff493b-16cc-4503-ba7c-3b8b6c73c530 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:55.786787 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-32ff493b-16cc-4503-ba7c-3b8b6c73c530 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:55.787223 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-32ff493b-16cc-4503-ba7c-3b8b6c73c530 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:55.913016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-32ff493b-16cc-4503-ba7c-3b8b6c73c530 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:55.921153 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-32ff493b-16cc-4503-ba7c-3b8b6c73c530 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:55.922656 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-32ff493b-16cc-4503-ba7c-3b8b6c73c530 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:55.923796 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-32ff493b-16cc-4503-ba7c-3b8b6c73c530 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.149488 Oct 28 08:50:55.924348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 645/1344] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:55 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:56.104155 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1f560455-393b-4f0a-893a-0ff88320f636 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:56.104685 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1f560455-393b-4f0a-893a-0ff88320f636 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:56.111258 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1f560455-393b-4f0a-893a-0ff88320f636 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:56.111697 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1f560455-393b-4f0a-893a-0ff88320f636 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:56.112479 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1f560455-393b-4f0a-893a-0ff88320f636 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:56.112904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1f560455-393b-4f0a-893a-0ff88320f636 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:56.243800 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-1f560455-393b-4f0a-893a-0ff88320f636 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:56.251260 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1f560455-393b-4f0a-893a-0ff88320f636 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.150896 Oct 28 08:50:56.251836 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 700/1345] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:56 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:56.941895 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6094373d-19f6-4a62-b1b0-203842081a67 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:56.943869 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6094373d-19f6-4a62-b1b0-203842081a67 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:56.949542 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6094373d-19f6-4a62-b1b0-203842081a67 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:56.950035 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6094373d-19f6-4a62-b1b0-203842081a67 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:56.950844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6094373d-19f6-4a62-b1b0-203842081a67 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:56.951282 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6094373d-19f6-4a62-b1b0-203842081a67 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:57.084716 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6094373d-19f6-4a62-b1b0-203842081a67 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:57.092434 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6094373d-19f6-4a62-b1b0-203842081a67 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:57.093960 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6094373d-19f6-4a62-b1b0-203842081a67 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:57.095113 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6094373d-19f6-4a62-b1b0-203842081a67 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.157074 Oct 28 08:50:57.095665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 646/1346] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:56 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:57.269013 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-21e0d127-3ec1-483f-a905-92bdece54741 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:57.269709 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-21e0d127-3ec1-483f-a905-92bdece54741 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:57.275864 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-21e0d127-3ec1-483f-a905-92bdece54741 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:57.276314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-21e0d127-3ec1-483f-a905-92bdece54741 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:57.277077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-21e0d127-3ec1-483f-a905-92bdece54741 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:57.277510 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-21e0d127-3ec1-483f-a905-92bdece54741 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:57.401129 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-21e0d127-3ec1-483f-a905-92bdece54741 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:57.408504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-21e0d127-3ec1-483f-a905-92bdece54741 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.143401 Oct 28 08:50:57.409075 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 701/1347] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:57 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:58.113863 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e1eaa938-f7a8-48f4-bb60-819ce8044db8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:58.114470 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e1eaa938-f7a8-48f4-bb60-819ce8044db8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:58.122633 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1eaa938-f7a8-48f4-bb60-819ce8044db8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:58.123082 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1eaa938-f7a8-48f4-bb60-819ce8044db8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:58.123852 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1eaa938-f7a8-48f4-bb60-819ce8044db8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:58.124287 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e1eaa938-f7a8-48f4-bb60-819ce8044db8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:58.259922 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e1eaa938-f7a8-48f4-bb60-819ce8044db8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:58.267772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e1eaa938-f7a8-48f4-bb60-819ce8044db8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:58.269269 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e1eaa938-f7a8-48f4-bb60-819ce8044db8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:58.270455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e1eaa938-f7a8-48f4-bb60-819ce8044db8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1738 microversion: 2.20 time: 0.160396 Oct 28 08:50:58.271016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 647/1348] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:58 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:58.427263 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-13d94441-2fca-4816-9efd-973013756955 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:58.427976 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-13d94441-2fca-4816-9efd-973013756955 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:58.436866 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-13d94441-2fca-4816-9efd-973013756955 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:58.441265 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-13d94441-2fca-4816-9efd-973013756955 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:58.442116 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-13d94441-2fca-4816-9efd-973013756955 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:58.442717 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-13d94441-2fca-4816-9efd-973013756955 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:58.564640 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-13d94441-2fca-4816-9efd-973013756955 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:58.572727 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-13d94441-2fca-4816-9efd-973013756955 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.149657 Oct 28 08:50:58.573393 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 702/1349] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:58 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:59.289123 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fd9cb91f-5f80-4881-9e56-cc0294bc6a94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:59.290013 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fd9cb91f-5f80-4881-9e56-cc0294bc6a94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:59.297134 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd9cb91f-5f80-4881-9e56-cc0294bc6a94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:59.297578 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd9cb91f-5f80-4881-9e56-cc0294bc6a94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:59.298611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd9cb91f-5f80-4881-9e56-cc0294bc6a94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:59.299040 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd9cb91f-5f80-4881-9e56-cc0294bc6a94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:59.589767 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d5341a49-78e5-4dbf-8575-a1c253dfe690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:59.590410 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d5341a49-78e5-4dbf-8575-a1c253dfe690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:59.597862 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5341a49-78e5-4dbf-8575-a1c253dfe690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:59.598314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5341a49-78e5-4dbf-8575-a1c253dfe690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:59.599098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5341a49-78e5-4dbf-8575-a1c253dfe690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:59.599535 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d5341a49-78e5-4dbf-8575-a1c253dfe690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:59.743120 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fd9cb91f-5f80-4881-9e56-cc0294bc6a94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:59.751041 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fd9cb91f-5f80-4881-9e56-cc0294bc6a94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:59.752528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fd9cb91f-5f80-4881-9e56-cc0294bc6a94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:59.753688 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fd9cb91f-5f80-4881-9e56-cc0294bc6a94 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1720 microversion: 2.20 time: 0.469102 Oct 28 08:50:59.754279 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 648/1350] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:59 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1720 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:59.774528 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d5341a49-78e5-4dbf-8575-a1c253dfe690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:59.781973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d5341a49-78e5-4dbf-8575-a1c253dfe690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.195915 Oct 28 08:50:59.782555 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 703/1351] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:59 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:00.774858 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7311229a-0a26-4d95-8ad8-5c63c31853a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:00.775469 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7311229a-0a26-4d95-8ad8-5c63c31853a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:00.781900 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7311229a-0a26-4d95-8ad8-5c63c31853a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:00.782338 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7311229a-0a26-4d95-8ad8-5c63c31853a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:00.783097 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7311229a-0a26-4d95-8ad8-5c63c31853a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:00.783517 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7311229a-0a26-4d95-8ad8-5c63c31853a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:00.798209 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-875f58c5-8f36-4f72-a72d-d097eb8f0daa tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:00.798815 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-875f58c5-8f36-4f72-a72d-d097eb8f0daa tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:00.805467 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-875f58c5-8f36-4f72-a72d-d097eb8f0daa tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:00.805950 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-875f58c5-8f36-4f72-a72d-d097eb8f0daa tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:00.806768 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-875f58c5-8f36-4f72-a72d-d097eb8f0daa tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:00.807208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-875f58c5-8f36-4f72-a72d-d097eb8f0daa tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:00.974127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7311229a-0a26-4d95-8ad8-5c63c31853a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:00.979524 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-875f58c5-8f36-4f72-a72d-d097eb8f0daa tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:00.982492 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7311229a-0a26-4d95-8ad8-5c63c31853a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:00.983982 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7311229a-0a26-4d95-8ad8-5c63c31853a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:00.985152 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7311229a-0a26-4d95-8ad8-5c63c31853a6 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1720 microversion: 2.20 time: 0.215077 Oct 28 08:51:00.985706 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 649/1352] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:00 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:00.986885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-875f58c5-8f36-4f72-a72d-d097eb8f0daa tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.192355 Oct 28 08:51:00.987447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 704/1353] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:00 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:02.004081 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a05c769d-ad4a-484e-8277-254291a427c5 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:02.004761 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-420aeb97-1ce0-47d0-a607-524125fe400a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:02.004761 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-420aeb97-1ce0-47d0-a607-524125fe400a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:02.005199 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a05c769d-ad4a-484e-8277-254291a427c5 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:02.011787 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-420aeb97-1ce0-47d0-a607-524125fe400a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:02.012031 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a05c769d-ad4a-484e-8277-254291a427c5 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:02.012227 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-420aeb97-1ce0-47d0-a607-524125fe400a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:02.012378 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a05c769d-ad4a-484e-8277-254291a427c5 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:02.013037 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-420aeb97-1ce0-47d0-a607-524125fe400a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:02.013163 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a05c769d-ad4a-484e-8277-254291a427c5 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:02.013471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-420aeb97-1ce0-47d0-a607-524125fe400a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:02.013587 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a05c769d-ad4a-484e-8277-254291a427c5 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:02.207651 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-420aeb97-1ce0-47d0-a607-524125fe400a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:02.210828 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a05c769d-ad4a-484e-8277-254291a427c5 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:02.217315 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-420aeb97-1ce0-47d0-a607-524125fe400a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:02.218661 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a05c769d-ad4a-484e-8277-254291a427c5 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.218292 Oct 28 08:51:02.218845 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-420aeb97-1ce0-47d0-a607-524125fe400a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:02.219359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 705/1354] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:01 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:02.220014 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-420aeb97-1ce0-47d0-a607-524125fe400a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1720 microversion: 2.20 time: 0.219902 Oct 28 08:51:02.220563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 650/1355] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:01 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:02.593030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-bcbde71f-2c95-4a08-8a52-d22646d0576c req-e2d8d181-8d6d-4970-ac8a-5681db4293ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44471d5a-b894-4e3f-b59d-b03afd03839b", "name": "network-vif-unplugged", "status": "completed", "tag": "21594cc8-c73a-42e8-9350-519f7620496e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:02.594614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:51:02.594614 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:51:02.602321 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-bcbde71f-2c95-4a08-8a52-d22646d0576c req-e2d8d181-8d6d-4970-ac8a-5681db4293ba service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:02.602760 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-bcbde71f-2c95-4a08-8a52-d22646d0576c req-e2d8d181-8d6d-4970-ac8a-5681db4293ba service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:02.615394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-bcbde71f-2c95-4a08-8a52-d22646d0576c req-e2d8d181-8d6d-4970-ac8a-5681db4293ba service nova] Creating event network-vif-unplugged:21594cc8-c73a-42e8-9350-519f7620496e for instance 44471d5a-b894-4e3f-b59d-b03afd03839b on hv-cinder-81566 Oct 28 08:51:02.621663 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-bcbde71f-2c95-4a08-8a52-d22646d0576c req-e2d8d181-8d6d-4970-ac8a-5681db4293ba service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032723 Oct 28 08:51:02.622287 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 706/1356] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:51:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:51:03.236447 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8f94fe82-113e-4745-9171-12ab35518da1 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:03.237050 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8f94fe82-113e-4745-9171-12ab35518da1 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:03.238181 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4160031b-7ccc-4d4a-b2a1-95768a2f413e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:03.238882 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4160031b-7ccc-4d4a-b2a1-95768a2f413e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:03.244499 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8f94fe82-113e-4745-9171-12ab35518da1 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:03.244948 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8f94fe82-113e-4745-9171-12ab35518da1 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:03.245726 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8f94fe82-113e-4745-9171-12ab35518da1 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:03.245953 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4160031b-7ccc-4d4a-b2a1-95768a2f413e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:03.246187 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8f94fe82-113e-4745-9171-12ab35518da1 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:03.246397 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4160031b-7ccc-4d4a-b2a1-95768a2f413e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:03.247172 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4160031b-7ccc-4d4a-b2a1-95768a2f413e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:03.247601 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4160031b-7ccc-4d4a-b2a1-95768a2f413e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:03.439240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-4160031b-7ccc-4d4a-b2a1-95768a2f413e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:03.447694 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-4160031b-7ccc-4d4a-b2a1-95768a2f413e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:03.449179 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-4160031b-7ccc-4d4a-b2a1-95768a2f413e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:03.450361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4160031b-7ccc-4d4a-b2a1-95768a2f413e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1720 microversion: 2.20 time: 0.216320 Oct 28 08:51:03.450925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 707/1357] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:03 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:03.451810 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8f94fe82-113e-4745-9171-12ab35518da1 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:03.459333 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8f94fe82-113e-4745-9171-12ab35518da1 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.226594 Oct 28 08:51:03.460417 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 651/1358] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:03 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:04.469469 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-40a344e7-804c-4b55-bbc2-e150c3f61f28 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:04.470230 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-40a344e7-804c-4b55-bbc2-e150c3f61f28 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:04.477420 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-40a344e7-804c-4b55-bbc2-e150c3f61f28 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:04.477901 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-40a344e7-804c-4b55-bbc2-e150c3f61f28 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:04.478072 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4af95936-f601-4385-9c2f-f7d7eeac3594 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:04.478877 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-40a344e7-804c-4b55-bbc2-e150c3f61f28 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:04.479103 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-40a344e7-804c-4b55-bbc2-e150c3f61f28 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:04.479257 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4af95936-f601-4385-9c2f-f7d7eeac3594 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:04.488605 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4af95936-f601-4385-9c2f-f7d7eeac3594 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:04.489061 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4af95936-f601-4385-9c2f-f7d7eeac3594 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:04.489878 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4af95936-f601-4385-9c2f-f7d7eeac3594 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:04.490313 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4af95936-f601-4385-9c2f-f7d7eeac3594 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:04.671953 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-40a344e7-804c-4b55-bbc2-e150c3f61f28 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:04.672840 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4af95936-f601-4385-9c2f-f7d7eeac3594 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:04.682564 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4af95936-f601-4385-9c2f-f7d7eeac3594 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.209800 Oct 28 08:51:04.683073 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 652/1359] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:04 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:04.683551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-40a344e7-804c-4b55-bbc2-e150c3f61f28 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:04.685348 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-40a344e7-804c-4b55-bbc2-e150c3f61f28 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:04.686754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-40a344e7-804c-4b55-bbc2-e150c3f61f28 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1720 microversion: 2.20 time: 0.221050 Oct 28 08:51:04.687382 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 708/1360] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:04 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:05.700191 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c11a72b8-a04d-4310-a8bd-62cc84f979b6 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:05.700890 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c11a72b8-a04d-4310-a8bd-62cc84f979b6 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:05.709616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c251ddd4-d49c-487a-a999-04076bc39c53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:05.710537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c251ddd4-d49c-487a-a999-04076bc39c53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:05.714574 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c11a72b8-a04d-4310-a8bd-62cc84f979b6 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:05.715264 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c11a72b8-a04d-4310-a8bd-62cc84f979b6 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:05.716465 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c11a72b8-a04d-4310-a8bd-62cc84f979b6 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:05.717101 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c11a72b8-a04d-4310-a8bd-62cc84f979b6 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:05.719015 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c251ddd4-d49c-487a-a999-04076bc39c53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:05.719476 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c251ddd4-d49c-487a-a999-04076bc39c53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:05.720351 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c251ddd4-d49c-487a-a999-04076bc39c53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:05.720783 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c251ddd4-d49c-487a-a999-04076bc39c53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:05.905844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c11a72b8-a04d-4310-a8bd-62cc84f979b6 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:05.913993 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c11a72b8-a04d-4310-a8bd-62cc84f979b6 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.216711 Oct 28 08:51:05.914948 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 653/1361] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:05 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:05.927306 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c251ddd4-d49c-487a-a999-04076bc39c53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:05.935892 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c251ddd4-d49c-487a-a999-04076bc39c53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:05.937375 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c251ddd4-d49c-487a-a999-04076bc39c53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:05.938561 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c251ddd4-d49c-487a-a999-04076bc39c53 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1720 microversion: 2.20 time: 0.233776 Oct 28 08:51:05.939127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 709/1362] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:05 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:06.931664 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-314008d8-9655-4bc5-93f0-17cfcfc968c7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:06.932269 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-314008d8-9655-4bc5-93f0-17cfcfc968c7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:06.938518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-314008d8-9655-4bc5-93f0-17cfcfc968c7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:06.938958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-314008d8-9655-4bc5-93f0-17cfcfc968c7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:06.939756 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-314008d8-9655-4bc5-93f0-17cfcfc968c7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:06.940184 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-314008d8-9655-4bc5-93f0-17cfcfc968c7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:06.957822 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4c10ff78-a3b9-4b8f-b11c-8afa1dfb7267 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:06.958472 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4c10ff78-a3b9-4b8f-b11c-8afa1dfb7267 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:06.965437 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c10ff78-a3b9-4b8f-b11c-8afa1dfb7267 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:06.965936 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c10ff78-a3b9-4b8f-b11c-8afa1dfb7267 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:06.968344 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c10ff78-a3b9-4b8f-b11c-8afa1dfb7267 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:06.968782 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4c10ff78-a3b9-4b8f-b11c-8afa1dfb7267 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.113096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-314008d8-9655-4bc5-93f0-17cfcfc968c7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:07.121674 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-314008d8-9655-4bc5-93f0-17cfcfc968c7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1510 microversion: 2.1 time: 0.193690 Oct 28 08:51:07.122330 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 654/1363] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:06 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:07.142295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-4c10ff78-a3b9-4b8f-b11c-8afa1dfb7267 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:07.142740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d7d1f93c-4398-434a-ba62-96b82a4c4cdb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:07.143308 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d7d1f93c-4398-434a-ba62-96b82a4c4cdb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:07.149441 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7d1f93c-4398-434a-ba62-96b82a4c4cdb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.149916 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7d1f93c-4398-434a-ba62-96b82a4c4cdb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.150591 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-4c10ff78-a3b9-4b8f-b11c-8afa1dfb7267 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:07.150711 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7d1f93c-4398-434a-ba62-96b82a4c4cdb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.151112 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7d1f93c-4398-434a-ba62-96b82a4c4cdb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.152086 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-4c10ff78-a3b9-4b8f-b11c-8afa1dfb7267 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:07.153327 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4c10ff78-a3b9-4b8f-b11c-8afa1dfb7267 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1663 microversion: 2.20 time: 0.199342 Oct 28 08:51:07.154120 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 710/1364] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:06 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1663 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:51:07.170640 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d3360055-c58a-44ed-9f59-42a85dcbaecf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "525c05b1-e6a7-4044-aabc-8a24a84fcfd7"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:07.171683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d3360055-c58a-44ed-9f59-42a85dcbaecf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:07.177682 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d3360055-c58a-44ed-9f59-42a85dcbaecf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.178161 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d3360055-c58a-44ed-9f59-42a85dcbaecf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.179525 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d3360055-c58a-44ed-9f59-42a85dcbaecf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.179957 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d3360055-c58a-44ed-9f59-42a85dcbaecf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.246296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d7d1f93c-4398-434a-ba62-96b82a4c4cdb tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "POST /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1/action" status: 202 len: 0 microversion: 2.1 time: 0.106932 Oct 28 08:51:07.247112 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 655/1365] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Oct 28 08:51:07 2021] POST /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:51:07.254752 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fd447cf5-9709-479c-8612-1faa3d24cb1d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:07.255300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fd447cf5-9709-479c-8612-1faa3d24cb1d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:07.262275 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd447cf5-9709-479c-8612-1faa3d24cb1d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.262724 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd447cf5-9709-479c-8612-1faa3d24cb1d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.263663 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd447cf5-9709-479c-8612-1faa3d24cb1d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.264243 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fd447cf5-9709-479c-8612-1faa3d24cb1d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.414039 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fd447cf5-9709-479c-8612-1faa3d24cb1d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:07.426103 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fd447cf5-9709-479c-8612-1faa3d24cb1d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1518 microversion: 2.1 time: 0.174802 Oct 28 08:51:07.427970 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 656/1366] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:07 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:07.483906 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d3360055-c58a-44ed-9f59-42a85dcbaecf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316881 Oct 28 08:51:07.484712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 711/1367] 10.222.0.74 () {62 vars in 1363 bytes} [Thu Oct 28 08:51:07 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/os-volume_attachments => generated 188 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:51:07.598782 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7d3c87a4-8f9a-47eb-9f4c-f81080810f1e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:07.599191 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7d3c87a4-8f9a-47eb-9f4c-f81080810f1e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:07.606351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7d3c87a4-8f9a-47eb-9f4c-f81080810f1e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.606814 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7d3c87a4-8f9a-47eb-9f4c-f81080810f1e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.607570 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7d3c87a4-8f9a-47eb-9f4c-f81080810f1e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.608117 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7d3c87a4-8f9a-47eb-9f4c-f81080810f1e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:08.448249 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-de22b5c2-d533-4c57-97c6-044c9edd3a5f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:08.448855 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-de22b5c2-d533-4c57-97c6-044c9edd3a5f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:08.455563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de22b5c2-d533-4c57-97c6-044c9edd3a5f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:08.455999 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de22b5c2-d533-4c57-97c6-044c9edd3a5f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:08.456790 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de22b5c2-d533-4c57-97c6-044c9edd3a5f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:08.457218 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-de22b5c2-d533-4c57-97c6-044c9edd3a5f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:08.585725 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-de22b5c2-d533-4c57-97c6-044c9edd3a5f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:08.593476 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-de22b5c2-d533-4c57-97c6-044c9edd3a5f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1518 microversion: 2.1 time: 0.149816 Oct 28 08:51:08.594096 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 712/1368] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:08 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:09.360976 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7d3c87a4-8f9a-47eb-9f4c-f81080810f1e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/os-volume_attachments/525c05b1-e6a7-4044-aabc-8a24a84fcfd7" status: 202 len: 0 microversion: 2.20 time: 1.766020 Oct 28 08:51:09.361607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 657/1369] 10.222.0.74 () {60 vars in 1456 bytes} [Thu Oct 28 08:51:07 2021] DELETE /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/os-volume_attachments/525c05b1-e6a7-4044-aabc-8a24a84fcfd7 => generated 0 bytes in 1768 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:51:09.417885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-27cb9411-84cb-4fef-bda1-ea7a7fdc435a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:09.418455 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-27cb9411-84cb-4fef-bda1-ea7a7fdc435a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:09.424696 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-27cb9411-84cb-4fef-bda1-ea7a7fdc435a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:09.425139 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-27cb9411-84cb-4fef-bda1-ea7a7fdc435a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:09.425952 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-27cb9411-84cb-4fef-bda1-ea7a7fdc435a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:09.426383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-27cb9411-84cb-4fef-bda1-ea7a7fdc435a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:09.517597 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: ERROR oslo.messaging._drivers.impl_rabbit [None req-27cb9411-84cb-4fef-bda1-ea7a7fdc435a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [d6788986-7fb7-487d-8416-fb57f3bc6e5b] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 08:51:09.611095 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-bcfc5bfa-5808-4122-a668-a4ceeb68fe6e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:09.611608 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-bcfc5bfa-5808-4122-a668-a4ceeb68fe6e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:09.619296 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bcfc5bfa-5808-4122-a668-a4ceeb68fe6e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:09.619732 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bcfc5bfa-5808-4122-a668-a4ceeb68fe6e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:09.620485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bcfc5bfa-5808-4122-a668-a4ceeb68fe6e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:09.620910 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-bcfc5bfa-5808-4122-a668-a4ceeb68fe6e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:09.751410 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-bcfc5bfa-5808-4122-a668-a4ceeb68fe6e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:09.759910 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-bcfc5bfa-5808-4122-a668-a4ceeb68fe6e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1518 microversion: 2.1 time: 0.152556 Oct 28 08:51:09.760482 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 658/1370] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:09 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:10.385350 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-56f5d700-2982-4bf6-a13c-386b4170239c req-172a4113-2a15-4aed-8d73-fba0df60943c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1", "name": "network-vif-unplugged", "status": "completed", "tag": "0151d785-b8a4-4437-9aa9-d788de11dd43"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:10.387026 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:51:10.387026 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:51:10.395042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-56f5d700-2982-4bf6-a13c-386b4170239c req-172a4113-2a15-4aed-8d73-fba0df60943c service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:10.395488 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-56f5d700-2982-4bf6-a13c-386b4170239c req-172a4113-2a15-4aed-8d73-fba0df60943c service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:10.406934 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.compute.server_external_events [req-56f5d700-2982-4bf6-a13c-386b4170239c req-172a4113-2a15-4aed-8d73-fba0df60943c service nova] Unable to find a host for instance d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1. Dropping event network-vif-unplugged {{(pid=132796) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 28 08:51:10.407894 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-56f5d700-2982-4bf6-a13c-386b4170239c req-172a4113-2a15-4aed-8d73-fba0df60943c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026985 Oct 28 08:51:10.408687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 659/1371] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:51:10 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 28 08:51:10.534574 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO oslo.messaging._drivers.impl_rabbit [None req-27cb9411-84cb-4fef-bda1-ea7a7fdc435a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [d6788986-7fb7-487d-8416-fb57f3bc6e5b] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 45900. Oct 28 08:51:10.541815 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-27cb9411-84cb-4fef-bda1-ea7a7fdc435a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action" status: 202 len: 0 microversion: 2.20 time: 1.128859 Oct 28 08:51:10.543125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 713/1372] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Oct 28 08:51:09 2021] POST /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/action => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:51:10.550519 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-91d6ae39-a298-4e5f-a1f2-0cf3837582a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:10.551125 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-91d6ae39-a298-4e5f-a1f2-0cf3837582a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:10.558255 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-91d6ae39-a298-4e5f-a1f2-0cf3837582a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:10.558795 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-91d6ae39-a298-4e5f-a1f2-0cf3837582a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:10.559641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-91d6ae39-a298-4e5f-a1f2-0cf3837582a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:10.560143 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-91d6ae39-a298-4e5f-a1f2-0cf3837582a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:10.694827 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-91d6ae39-a298-4e5f-a1f2-0cf3837582a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:10.702076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-91d6ae39-a298-4e5f-a1f2-0cf3837582a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:10.703563 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-91d6ae39-a298-4e5f-a1f2-0cf3837582a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:10.704721 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-91d6ae39-a298-4e5f-a1f2-0cf3837582a2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1671 microversion: 2.20 time: 0.157893 Oct 28 08:51:10.705276 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 660/1373] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:10 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:10.777752 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-dae73017-c7b5-4dc9-a2d3-a0bcd69bef32 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:10.778383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-dae73017-c7b5-4dc9-a2d3-a0bcd69bef32 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:10.791316 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dae73017-c7b5-4dc9-a2d3-a0bcd69bef32 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:10.791768 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dae73017-c7b5-4dc9-a2d3-a0bcd69bef32 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:10.792916 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dae73017-c7b5-4dc9-a2d3-a0bcd69bef32 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:10.793021 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-dae73017-c7b5-4dc9-a2d3-a0bcd69bef32 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:10.941512 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-dae73017-c7b5-4dc9-a2d3-a0bcd69bef32 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:10.949396 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-dae73017-c7b5-4dc9-a2d3-a0bcd69bef32 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1518 microversion: 2.1 time: 0.175893 Oct 28 08:51:10.950011 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 714/1374] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:10 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:11.723203 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ffcf0a6c-a71c-43ad-b9cd-bc34c7dd521f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:11.723851 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ffcf0a6c-a71c-43ad-b9cd-bc34c7dd521f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:11.730464 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ffcf0a6c-a71c-43ad-b9cd-bc34c7dd521f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:11.730915 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ffcf0a6c-a71c-43ad-b9cd-bc34c7dd521f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:11.731688 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ffcf0a6c-a71c-43ad-b9cd-bc34c7dd521f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:11.732125 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ffcf0a6c-a71c-43ad-b9cd-bc34c7dd521f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:11.885124 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ffcf0a6c-a71c-43ad-b9cd-bc34c7dd521f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:11.894004 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ffcf0a6c-a71c-43ad-b9cd-bc34c7dd521f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:11.895633 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ffcf0a6c-a71c-43ad-b9cd-bc34c7dd521f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:11.896808 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ffcf0a6c-a71c-43ad-b9cd-bc34c7dd521f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1671 microversion: 2.20 time: 0.177354 Oct 28 08:51:11.897560 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 661/1375] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:11 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:11.967078 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8c9b6316-19bc-4545-805b-09a91ea3bcfe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:11.967860 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8c9b6316-19bc-4545-805b-09a91ea3bcfe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:11.974417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8c9b6316-19bc-4545-805b-09a91ea3bcfe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:11.974963 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8c9b6316-19bc-4545-805b-09a91ea3bcfe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:11.976280 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8c9b6316-19bc-4545-805b-09a91ea3bcfe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:11.976947 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8c9b6316-19bc-4545-805b-09a91ea3bcfe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:12.115594 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8c9b6316-19bc-4545-805b-09a91ea3bcfe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:12.124601 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8c9b6316-19bc-4545-805b-09a91ea3bcfe tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1520 microversion: 2.1 time: 0.161786 Oct 28 08:51:12.125381 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 715/1376] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:11 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:12.916438 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-7de37804-c238-44e1-a901-192151c020b7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:12.916965 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-7de37804-c238-44e1-a901-192151c020b7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:12.923523 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7de37804-c238-44e1-a901-192151c020b7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:12.923969 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7de37804-c238-44e1-a901-192151c020b7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:12.924736 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7de37804-c238-44e1-a901-192151c020b7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:12.925159 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-7de37804-c238-44e1-a901-192151c020b7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:13.065715 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7de37804-c238-44e1-a901-192151c020b7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:13.078340 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7de37804-c238-44e1-a901-192151c020b7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:13.080132 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-7de37804-c238-44e1-a901-192151c020b7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:13.081457 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-7de37804-c238-44e1-a901-192151c020b7 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.169943 Oct 28 08:51:13.093362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 662/1377] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:12 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:13.142688 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3d534962-b354-4ade-af7d-9fae9e5aaf70 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:13.144008 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3d534962-b354-4ade-af7d-9fae9e5aaf70 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:13.152585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d534962-b354-4ade-af7d-9fae9e5aaf70 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:13.153537 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d534962-b354-4ade-af7d-9fae9e5aaf70 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:13.154661 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d534962-b354-4ade-af7d-9fae9e5aaf70 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:13.155181 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3d534962-b354-4ade-af7d-9fae9e5aaf70 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:13.310558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3d534962-b354-4ade-af7d-9fae9e5aaf70 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:13.320296 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3d534962-b354-4ade-af7d-9fae9e5aaf70 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1520 microversion: 2.1 time: 0.180617 Oct 28 08:51:13.321070 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 716/1378] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:13 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:14.101252 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5a9a4820-385b-457d-b3d3-e6488fba883b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:14.102086 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5a9a4820-385b-457d-b3d3-e6488fba883b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:14.108434 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a9a4820-385b-457d-b3d3-e6488fba883b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:14.108888 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a9a4820-385b-457d-b3d3-e6488fba883b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:14.109672 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a9a4820-385b-457d-b3d3-e6488fba883b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:14.110134 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5a9a4820-385b-457d-b3d3-e6488fba883b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:14.264528 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5a9a4820-385b-457d-b3d3-e6488fba883b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:14.273607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5a9a4820-385b-457d-b3d3-e6488fba883b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:14.275150 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5a9a4820-385b-457d-b3d3-e6488fba883b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:14.276328 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5a9a4820-385b-457d-b3d3-e6488fba883b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.179431 Oct 28 08:51:14.279785 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 663/1379] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:14 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:14.339422 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ae9cb389-c129-4a74-a8c4-2d2e1972e1d7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:14.340158 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ae9cb389-c129-4a74-a8c4-2d2e1972e1d7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:14.346746 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae9cb389-c129-4a74-a8c4-2d2e1972e1d7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:14.347194 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae9cb389-c129-4a74-a8c4-2d2e1972e1d7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:14.348038 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae9cb389-c129-4a74-a8c4-2d2e1972e1d7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:14.348480 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ae9cb389-c129-4a74-a8c4-2d2e1972e1d7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:14.542961 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ae9cb389-c129-4a74-a8c4-2d2e1972e1d7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:14.550528 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ae9cb389-c129-4a74-a8c4-2d2e1972e1d7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.215263 Oct 28 08:51:14.551125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 717/1380] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:14 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:15.295075 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d46dce6a-c5c8-40c2-9ad1-4e30ecf4b9b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:15.295664 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d46dce6a-c5c8-40c2-9ad1-4e30ecf4b9b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:15.301820 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d46dce6a-c5c8-40c2-9ad1-4e30ecf4b9b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:15.302339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d46dce6a-c5c8-40c2-9ad1-4e30ecf4b9b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:15.303166 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d46dce6a-c5c8-40c2-9ad1-4e30ecf4b9b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:15.304432 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d46dce6a-c5c8-40c2-9ad1-4e30ecf4b9b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:15.456202 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d46dce6a-c5c8-40c2-9ad1-4e30ecf4b9b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:15.465884 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d46dce6a-c5c8-40c2-9ad1-4e30ecf4b9b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:15.467517 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d46dce6a-c5c8-40c2-9ad1-4e30ecf4b9b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:15.468802 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d46dce6a-c5c8-40c2-9ad1-4e30ecf4b9b5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.177418 Oct 28 08:51:15.469451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 664/1381] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:15 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:15.573582 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2e64a191-e600-41da-97b0-c84c79f97c20 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:15.574839 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2e64a191-e600-41da-97b0-c84c79f97c20 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:15.581305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2e64a191-e600-41da-97b0-c84c79f97c20 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:15.581908 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2e64a191-e600-41da-97b0-c84c79f97c20 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:15.582689 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2e64a191-e600-41da-97b0-c84c79f97c20 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:15.583121 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2e64a191-e600-41da-97b0-c84c79f97c20 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:15.714526 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2e64a191-e600-41da-97b0-c84c79f97c20 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:15.723213 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2e64a191-e600-41da-97b0-c84c79f97c20 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.156017 Oct 28 08:51:15.723927 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 718/1382] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:15 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:16.488763 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4b6a7cc3-a6dd-4314-b7ff-c6947207da60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:16.489322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4b6a7cc3-a6dd-4314-b7ff-c6947207da60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:16.496439 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b6a7cc3-a6dd-4314-b7ff-c6947207da60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:16.496886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b6a7cc3-a6dd-4314-b7ff-c6947207da60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:16.497651 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b6a7cc3-a6dd-4314-b7ff-c6947207da60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:16.498108 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4b6a7cc3-a6dd-4314-b7ff-c6947207da60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:16.639012 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4b6a7cc3-a6dd-4314-b7ff-c6947207da60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:16.647347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4b6a7cc3-a6dd-4314-b7ff-c6947207da60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:16.649228 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4b6a7cc3-a6dd-4314-b7ff-c6947207da60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:16.650423 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4b6a7cc3-a6dd-4314-b7ff-c6947207da60 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.165791 Oct 28 08:51:16.650983 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 665/1383] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:16 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:16.741713 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9b45d088-803c-450f-bc01-26c6cc4bf223 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:16.742349 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9b45d088-803c-450f-bc01-26c6cc4bf223 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:16.748563 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b45d088-803c-450f-bc01-26c6cc4bf223 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:16.749042 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b45d088-803c-450f-bc01-26c6cc4bf223 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:16.749777 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b45d088-803c-450f-bc01-26c6cc4bf223 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:16.750248 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b45d088-803c-450f-bc01-26c6cc4bf223 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:16.889301 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9b45d088-803c-450f-bc01-26c6cc4bf223 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:16.896886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9b45d088-803c-450f-bc01-26c6cc4bf223 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.159488 Oct 28 08:51:16.898755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 719/1384] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:16 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:17.668787 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-aa186845-5ba7-47b4-9c38-cc6aeebdbaf2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:17.669461 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-aa186845-5ba7-47b4-9c38-cc6aeebdbaf2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:17.675846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aa186845-5ba7-47b4-9c38-cc6aeebdbaf2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:17.676286 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aa186845-5ba7-47b4-9c38-cc6aeebdbaf2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:17.677049 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aa186845-5ba7-47b4-9c38-cc6aeebdbaf2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:17.677505 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-aa186845-5ba7-47b4-9c38-cc6aeebdbaf2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:17.821844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aa186845-5ba7-47b4-9c38-cc6aeebdbaf2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:17.830944 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aa186845-5ba7-47b4-9c38-cc6aeebdbaf2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:17.832592 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-aa186845-5ba7-47b4-9c38-cc6aeebdbaf2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:17.834075 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-aa186845-5ba7-47b4-9c38-cc6aeebdbaf2 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.169249 Oct 28 08:51:17.834865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 666/1385] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:17 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:17.917035 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7db1740f-e28d-4de5-804e-859c9aaa6f9b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:17.917626 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7db1740f-e28d-4de5-804e-859c9aaa6f9b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:17.924152 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7db1740f-e28d-4de5-804e-859c9aaa6f9b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:17.924595 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7db1740f-e28d-4de5-804e-859c9aaa6f9b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:17.925417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7db1740f-e28d-4de5-804e-859c9aaa6f9b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:17.925818 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7db1740f-e28d-4de5-804e-859c9aaa6f9b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:18.095395 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-7db1740f-e28d-4de5-804e-859c9aaa6f9b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:18.104428 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7db1740f-e28d-4de5-804e-859c9aaa6f9b tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.193540 Oct 28 08:51:18.105008 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 720/1386] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:17 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:18.856225 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-8ef199c0-eb85-4dc4-9def-30aafbcf1c8a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:18.856785 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-8ef199c0-eb85-4dc4-9def-30aafbcf1c8a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:18.862823 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8ef199c0-eb85-4dc4-9def-30aafbcf1c8a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:18.863273 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8ef199c0-eb85-4dc4-9def-30aafbcf1c8a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:18.864029 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8ef199c0-eb85-4dc4-9def-30aafbcf1c8a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:18.864467 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-8ef199c0-eb85-4dc4-9def-30aafbcf1c8a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:18.992620 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8ef199c0-eb85-4dc4-9def-30aafbcf1c8a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:19.000832 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8ef199c0-eb85-4dc4-9def-30aafbcf1c8a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:19.002350 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-8ef199c0-eb85-4dc4-9def-30aafbcf1c8a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:19.003558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-8ef199c0-eb85-4dc4-9def-30aafbcf1c8a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.154996 Oct 28 08:51:19.004173 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 667/1387] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:18 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:19.122529 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2fefa075-34d0-4637-8649-fb37c2456abd tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:19.123924 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2fefa075-34d0-4637-8649-fb37c2456abd tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:19.131148 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2fefa075-34d0-4637-8649-fb37c2456abd tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:19.132942 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2fefa075-34d0-4637-8649-fb37c2456abd tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:19.134634 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2fefa075-34d0-4637-8649-fb37c2456abd tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:19.135737 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2fefa075-34d0-4637-8649-fb37c2456abd tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:19.271787 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2fefa075-34d0-4637-8649-fb37c2456abd tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:19.279626 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2fefa075-34d0-4637-8649-fb37c2456abd tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.160941 Oct 28 08:51:19.280220 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 721/1388] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:19 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:20.025209 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-660605e5-2ae1-4fbd-b981-d0c2dc8121b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:20.025780 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-660605e5-2ae1-4fbd-b981-d0c2dc8121b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:20.033088 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-660605e5-2ae1-4fbd-b981-d0c2dc8121b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:20.033535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-660605e5-2ae1-4fbd-b981-d0c2dc8121b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:20.034343 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-660605e5-2ae1-4fbd-b981-d0c2dc8121b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:20.034780 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-660605e5-2ae1-4fbd-b981-d0c2dc8121b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:20.191577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-660605e5-2ae1-4fbd-b981-d0c2dc8121b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:20.201585 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-660605e5-2ae1-4fbd-b981-d0c2dc8121b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:20.203339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-660605e5-2ae1-4fbd-b981-d0c2dc8121b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:20.204546 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-660605e5-2ae1-4fbd-b981-d0c2dc8121b8 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.185007 Oct 28 08:51:20.205109 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 668/1389] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:20 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:20.297207 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ac1290a0-af33-4024-8861-b06e9d6c4c4f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:20.297836 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ac1290a0-af33-4024-8861-b06e9d6c4c4f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:20.304900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac1290a0-af33-4024-8861-b06e9d6c4c4f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:20.305337 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac1290a0-af33-4024-8861-b06e9d6c4c4f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:20.306259 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac1290a0-af33-4024-8861-b06e9d6c4c4f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:20.306701 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac1290a0-af33-4024-8861-b06e9d6c4c4f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:20.449930 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ac1290a0-af33-4024-8861-b06e9d6c4c4f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:20.458033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ac1290a0-af33-4024-8861-b06e9d6c4c4f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.164510 Oct 28 08:51:20.458858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 722/1390] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:20 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:21.224076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-296093ad-1f40-4a8b-821c-a39f747ccb20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:21.224683 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-296093ad-1f40-4a8b-821c-a39f747ccb20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:21.232392 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-296093ad-1f40-4a8b-821c-a39f747ccb20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:21.233173 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-296093ad-1f40-4a8b-821c-a39f747ccb20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:21.233991 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-296093ad-1f40-4a8b-821c-a39f747ccb20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:21.234692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-296093ad-1f40-4a8b-821c-a39f747ccb20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:21.378191 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-296093ad-1f40-4a8b-821c-a39f747ccb20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:21.386514 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-296093ad-1f40-4a8b-821c-a39f747ccb20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:21.387998 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-296093ad-1f40-4a8b-821c-a39f747ccb20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:21.389219 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-296093ad-1f40-4a8b-821c-a39f747ccb20 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.168935 Oct 28 08:51:21.389807 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 669/1391] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:21 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:21.478517 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9f73d66b-bb94-49f3-bb86-9bef78c4ed43 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:21.479123 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9f73d66b-bb94-49f3-bb86-9bef78c4ed43 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:21.486863 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f73d66b-bb94-49f3-bb86-9bef78c4ed43 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:21.487305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f73d66b-bb94-49f3-bb86-9bef78c4ed43 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:21.488080 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f73d66b-bb94-49f3-bb86-9bef78c4ed43 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:21.488506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f73d66b-bb94-49f3-bb86-9bef78c4ed43 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:21.638670 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9f73d66b-bb94-49f3-bb86-9bef78c4ed43 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:21.648051 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9f73d66b-bb94-49f3-bb86-9bef78c4ed43 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.173579 Oct 28 08:51:21.649054 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 723/1392] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:21 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:22.564408 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c8a08cf3-bd88-4de6-a823-e20e2f21016a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:22.565008 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c8a08cf3-bd88-4de6-a823-e20e2f21016a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:22.572544 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c8a08cf3-bd88-4de6-a823-e20e2f21016a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:22.573554 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c8a08cf3-bd88-4de6-a823-e20e2f21016a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:22.574857 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c8a08cf3-bd88-4de6-a823-e20e2f21016a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:22.575877 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c8a08cf3-bd88-4de6-a823-e20e2f21016a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:22.666216 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-03ca1889-8c25-4831-8351-516dfd67bc6d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:22.667379 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-03ca1889-8c25-4831-8351-516dfd67bc6d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:22.689679 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03ca1889-8c25-4831-8351-516dfd67bc6d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:22.690421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03ca1889-8c25-4831-8351-516dfd67bc6d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:22.691461 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03ca1889-8c25-4831-8351-516dfd67bc6d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:22.692136 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03ca1889-8c25-4831-8351-516dfd67bc6d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:22.728937 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c8a08cf3-bd88-4de6-a823-e20e2f21016a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:22.734922 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c8a08cf3-bd88-4de6-a823-e20e2f21016a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:22.736596 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c8a08cf3-bd88-4de6-a823-e20e2f21016a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:22.737751 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c8a08cf3-bd88-4de6-a823-e20e2f21016a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.333962 Oct 28 08:51:22.738673 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 670/1393] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:22 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:22.848638 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-03ca1889-8c25-4831-8351-516dfd67bc6d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:22.857455 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-03ca1889-8c25-4831-8351-516dfd67bc6d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.196910 Oct 28 08:51:22.858656 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 724/1394] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:22 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:23.758146 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5c309733-d4a6-4614-a3f6-5c954718f3e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:23.758729 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5c309733-d4a6-4614-a3f6-5c954718f3e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:23.764839 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5c309733-d4a6-4614-a3f6-5c954718f3e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:23.765542 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5c309733-d4a6-4614-a3f6-5c954718f3e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:23.766697 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5c309733-d4a6-4614-a3f6-5c954718f3e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:23.766893 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5c309733-d4a6-4614-a3f6-5c954718f3e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:23.875595 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-79483892-7c29-4e2f-9791-229aaa21762d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:23.876363 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-79483892-7c29-4e2f-9791-229aaa21762d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:23.888896 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79483892-7c29-4e2f-9791-229aaa21762d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:23.889341 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79483892-7c29-4e2f-9791-229aaa21762d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:23.890505 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79483892-7c29-4e2f-9791-229aaa21762d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:23.891133 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-79483892-7c29-4e2f-9791-229aaa21762d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:23.906070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5c309733-d4a6-4614-a3f6-5c954718f3e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:23.915007 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5c309733-d4a6-4614-a3f6-5c954718f3e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:23.916796 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5c309733-d4a6-4614-a3f6-5c954718f3e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:23.918010 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5c309733-d4a6-4614-a3f6-5c954718f3e5 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.164240 Oct 28 08:51:23.922327 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 671/1395] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:23 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:24.048224 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-79483892-7c29-4e2f-9791-229aaa21762d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:24.061127 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-79483892-7c29-4e2f-9791-229aaa21762d tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.189558 Oct 28 08:51:24.061922 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 725/1396] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:23 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:24.937152 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-530fade2-6c4e-4fba-9510-e49d8821b8bf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:24.938665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-530fade2-6c4e-4fba-9510-e49d8821b8bf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:24.947413 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-530fade2-6c4e-4fba-9510-e49d8821b8bf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:24.948176 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-530fade2-6c4e-4fba-9510-e49d8821b8bf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:24.949664 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-530fade2-6c4e-4fba-9510-e49d8821b8bf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:24.950366 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-530fade2-6c4e-4fba-9510-e49d8821b8bf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:25.078321 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-307ae730-9771-4661-acee-567bfd26c975 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:25.080166 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-307ae730-9771-4661-acee-567bfd26c975 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:25.089253 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-307ae730-9771-4661-acee-567bfd26c975 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:25.090458 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-307ae730-9771-4661-acee-567bfd26c975 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:25.091821 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-530fade2-6c4e-4fba-9510-e49d8821b8bf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:25.092301 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-307ae730-9771-4661-acee-567bfd26c975 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:25.092949 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-307ae730-9771-4661-acee-567bfd26c975 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:25.100218 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-530fade2-6c4e-4fba-9510-e49d8821b8bf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:25.102089 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-530fade2-6c4e-4fba-9510-e49d8821b8bf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:25.103275 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-530fade2-6c4e-4fba-9510-e49d8821b8bf tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.170302 Oct 28 08:51:25.103839 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 672/1397] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:24 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:25.234840 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-307ae730-9771-4661-acee-567bfd26c975 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:25.242955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-307ae730-9771-4661-acee-567bfd26c975 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.168367 Oct 28 08:51:25.243543 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 726/1398] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:25 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:26.121421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4a0a8513-491d-4137-a103-c064cc07848a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:26.122051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4a0a8513-491d-4137-a103-c064cc07848a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:26.128273 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a0a8513-491d-4137-a103-c064cc07848a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:26.128718 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a0a8513-491d-4137-a103-c064cc07848a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:26.129479 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a0a8513-491d-4137-a103-c064cc07848a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:26.129950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a0a8513-491d-4137-a103-c064cc07848a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:26.260199 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4a0a8513-491d-4137-a103-c064cc07848a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:26.262070 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9f5ae234-ec46-4110-94a8-3fabd57e9d09 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:26.263346 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9f5ae234-ec46-4110-94a8-3fabd57e9d09 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:26.268699 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4a0a8513-491d-4137-a103-c064cc07848a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:26.269704 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f5ae234-ec46-4110-94a8-3fabd57e9d09 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:26.270280 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f5ae234-ec46-4110-94a8-3fabd57e9d09 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:26.270487 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4a0a8513-491d-4137-a103-c064cc07848a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:26.271058 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f5ae234-ec46-4110-94a8-3fabd57e9d09 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:26.271483 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f5ae234-ec46-4110-94a8-3fabd57e9d09 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:26.271848 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4a0a8513-491d-4137-a103-c064cc07848a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.154054 Oct 28 08:51:26.283260 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 673/1399] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:26 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:26.413877 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9f5ae234-ec46-4110-94a8-3fabd57e9d09 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:26.421547 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9f5ae234-ec46-4110-94a8-3fabd57e9d09 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.165059 Oct 28 08:51:26.422143 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 727/1400] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:26 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:27.292755 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c269ec0b-a90b-4599-882f-728d03592061 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:27.293354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c269ec0b-a90b-4599-882f-728d03592061 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:27.300396 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c269ec0b-a90b-4599-882f-728d03592061 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:27.300859 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c269ec0b-a90b-4599-882f-728d03592061 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:27.301650 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c269ec0b-a90b-4599-882f-728d03592061 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:27.302128 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c269ec0b-a90b-4599-882f-728d03592061 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:27.440852 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-f9aeedb0-fbc0-4e32-9f29-2531809085d0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:27.441449 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-f9aeedb0-fbc0-4e32-9f29-2531809085d0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:27.447058 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c269ec0b-a90b-4599-882f-728d03592061 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:27.447815 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9aeedb0-fbc0-4e32-9f29-2531809085d0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:27.448257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9aeedb0-fbc0-4e32-9f29-2531809085d0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:27.449025 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9aeedb0-fbc0-4e32-9f29-2531809085d0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:27.449448 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-f9aeedb0-fbc0-4e32-9f29-2531809085d0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:27.455362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c269ec0b-a90b-4599-882f-728d03592061 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:27.456958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c269ec0b-a90b-4599-882f-728d03592061 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:27.458276 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c269ec0b-a90b-4599-882f-728d03592061 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.170818 Oct 28 08:51:27.459168 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 674/1401] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:27 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:27.607009 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-f9aeedb0-fbc0-4e32-9f29-2531809085d0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:27.615880 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-f9aeedb0-fbc0-4e32-9f29-2531809085d0 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.178630 Oct 28 08:51:27.618104 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 728/1402] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:27 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:28.477232 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-21c74b4f-3141-4e1e-a11b-53ea050e6e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:28.477900 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-21c74b4f-3141-4e1e-a11b-53ea050e6e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:28.484306 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21c74b4f-3141-4e1e-a11b-53ea050e6e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:28.484787 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21c74b4f-3141-4e1e-a11b-53ea050e6e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:28.485575 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21c74b4f-3141-4e1e-a11b-53ea050e6e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:28.486038 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21c74b4f-3141-4e1e-a11b-53ea050e6e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:28.618061 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-21c74b4f-3141-4e1e-a11b-53ea050e6e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:28.629092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-21c74b4f-3141-4e1e-a11b-53ea050e6e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:28.629092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-21c74b4f-3141-4e1e-a11b-53ea050e6e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:28.630617 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-21c74b4f-3141-4e1e-a11b-53ea050e6e51 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.157744 Oct 28 08:51:28.631493 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 675/1403] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:28 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:28.644413 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b38962ce-3d35-4564-9437-ef4df0588d13 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:28.645032 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b38962ce-3d35-4564-9437-ef4df0588d13 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:28.652073 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b38962ce-3d35-4564-9437-ef4df0588d13 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:28.652519 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b38962ce-3d35-4564-9437-ef4df0588d13 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:28.653316 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b38962ce-3d35-4564-9437-ef4df0588d13 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:28.653888 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b38962ce-3d35-4564-9437-ef4df0588d13 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:28.778778 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b38962ce-3d35-4564-9437-ef4df0588d13 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:28.787054 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b38962ce-3d35-4564-9437-ef4df0588d13 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.156499 Oct 28 08:51:28.787736 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 729/1404] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:28 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:29.648827 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5f4c9d6f-5620-47c4-9dad-d9f555a5ba56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:29.649441 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5f4c9d6f-5620-47c4-9dad-d9f555a5ba56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:29.655812 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5f4c9d6f-5620-47c4-9dad-d9f555a5ba56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:29.656254 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5f4c9d6f-5620-47c4-9dad-d9f555a5ba56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:29.657021 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5f4c9d6f-5620-47c4-9dad-d9f555a5ba56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:29.657471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5f4c9d6f-5620-47c4-9dad-d9f555a5ba56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:29.786998 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5f4c9d6f-5620-47c4-9dad-d9f555a5ba56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:29.795121 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5f4c9d6f-5620-47c4-9dad-d9f555a5ba56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:29.796631 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5f4c9d6f-5620-47c4-9dad-d9f555a5ba56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:29.797807 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5f4c9d6f-5620-47c4-9dad-d9f555a5ba56 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.152680 Oct 28 08:51:29.798372 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 676/1405] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:29 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:29.806018 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c6afc2c2-57d2-4cdb-8091-86b10eeb353e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:29.806637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c6afc2c2-57d2-4cdb-8091-86b10eeb353e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:29.812693 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6afc2c2-57d2-4cdb-8091-86b10eeb353e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:29.813137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6afc2c2-57d2-4cdb-8091-86b10eeb353e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:29.813928 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6afc2c2-57d2-4cdb-8091-86b10eeb353e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:29.814366 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c6afc2c2-57d2-4cdb-8091-86b10eeb353e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:29.954876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c6afc2c2-57d2-4cdb-8091-86b10eeb353e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:29.962784 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c6afc2c2-57d2-4cdb-8091-86b10eeb353e tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.161145 Oct 28 08:51:29.963349 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 730/1406] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:29 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:30.817747 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-330a1127-8719-4692-95d0-b70e5ac7feeb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:30.818419 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-330a1127-8719-4692-95d0-b70e5ac7feeb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:30.825364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-330a1127-8719-4692-95d0-b70e5ac7feeb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:30.825831 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-330a1127-8719-4692-95d0-b70e5ac7feeb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:30.826601 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-330a1127-8719-4692-95d0-b70e5ac7feeb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:30.827031 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-330a1127-8719-4692-95d0-b70e5ac7feeb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:30.951860 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-330a1127-8719-4692-95d0-b70e5ac7feeb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:30.959643 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-330a1127-8719-4692-95d0-b70e5ac7feeb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:30.962017 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-330a1127-8719-4692-95d0-b70e5ac7feeb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:30.963300 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-330a1127-8719-4692-95d0-b70e5ac7feeb tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.149393 Oct 28 08:51:30.963871 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 677/1407] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:30 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:30.979623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-30f92077-97fa-49f8-b8e8-ed0edf2a21a8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:30.980241 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-30f92077-97fa-49f8-b8e8-ed0edf2a21a8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:30.987074 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-30f92077-97fa-49f8-b8e8-ed0edf2a21a8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:30.987354 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-30f92077-97fa-49f8-b8e8-ed0edf2a21a8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:30.988101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-30f92077-97fa-49f8-b8e8-ed0edf2a21a8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:30.988515 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-30f92077-97fa-49f8-b8e8-ed0edf2a21a8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:31.122971 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-30f92077-97fa-49f8-b8e8-ed0edf2a21a8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:31.132616 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-30f92077-97fa-49f8-b8e8-ed0edf2a21a8 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.155998 Oct 28 08:51:31.133313 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 731/1408] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:30 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:31.982840 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c04ab5e7-838e-4d87-9a05-7f9df889935e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:31.983395 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c04ab5e7-838e-4d87-9a05-7f9df889935e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:31.989583 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c04ab5e7-838e-4d87-9a05-7f9df889935e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:31.990065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c04ab5e7-838e-4d87-9a05-7f9df889935e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:31.990833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c04ab5e7-838e-4d87-9a05-7f9df889935e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:31.991733 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c04ab5e7-838e-4d87-9a05-7f9df889935e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:32.120760 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c04ab5e7-838e-4d87-9a05-7f9df889935e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:32.128860 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c04ab5e7-838e-4d87-9a05-7f9df889935e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:32.130506 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c04ab5e7-838e-4d87-9a05-7f9df889935e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:32.131662 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c04ab5e7-838e-4d87-9a05-7f9df889935e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.152691 Oct 28 08:51:32.132326 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 678/1409] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:31 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:51:32.149946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e6e8fd59-5e4f-493b-a819-da20d78b5114 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:32.150551 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e6e8fd59-5e4f-493b-a819-da20d78b5114 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:32.157276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e6e8fd59-5e4f-493b-a819-da20d78b5114 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:32.157900 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e6e8fd59-5e4f-493b-a819-da20d78b5114 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:32.158683 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e6e8fd59-5e4f-493b-a819-da20d78b5114 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:32.159119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-e6e8fd59-5e4f-493b-a819-da20d78b5114 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:32.299566 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e6e8fd59-5e4f-493b-a819-da20d78b5114 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:32.306950 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e6e8fd59-5e4f-493b-a819-da20d78b5114 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.161222 Oct 28 08:51:32.307525 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 732/1410] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:32 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:33.150162 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-017b2451-378a-4fc7-94f0-3dc03522f394 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:33.150887 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-017b2451-378a-4fc7-94f0-3dc03522f394 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:33.157891 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-017b2451-378a-4fc7-94f0-3dc03522f394 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:33.158347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-017b2451-378a-4fc7-94f0-3dc03522f394 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:33.159146 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-017b2451-378a-4fc7-94f0-3dc03522f394 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:33.159585 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-017b2451-378a-4fc7-94f0-3dc03522f394 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:33.323956 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-001824d5-3cf5-4f83-944a-e3b0a5204d62 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:33.324554 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-001824d5-3cf5-4f83-944a-e3b0a5204d62 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:33.331079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-001824d5-3cf5-4f83-944a-e3b0a5204d62 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:33.331520 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-001824d5-3cf5-4f83-944a-e3b0a5204d62 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:33.332298 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-001824d5-3cf5-4f83-944a-e3b0a5204d62 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:33.332728 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-001824d5-3cf5-4f83-944a-e3b0a5204d62 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:33.430136 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-017b2451-378a-4fc7-94f0-3dc03522f394 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:33.438351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-017b2451-378a-4fc7-94f0-3dc03522f394 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:33.439847 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-017b2451-378a-4fc7-94f0-3dc03522f394 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:33.441021 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-017b2451-378a-4fc7-94f0-3dc03522f394 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.294726 Oct 28 08:51:33.441586 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 679/1411] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:33 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:33.523881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-001824d5-3cf5-4f83-944a-e3b0a5204d62 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:33.532501 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-001824d5-3cf5-4f83-944a-e3b0a5204d62 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.212304 Oct 28 08:51:33.533088 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 733/1412] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:33 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:34.459309 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-547936ac-5483-48ee-a0a5-cb21cdef98c3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:34.460010 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-547936ac-5483-48ee-a0a5-cb21cdef98c3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:34.467329 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-547936ac-5483-48ee-a0a5-cb21cdef98c3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:34.467772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-547936ac-5483-48ee-a0a5-cb21cdef98c3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:34.468545 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-547936ac-5483-48ee-a0a5-cb21cdef98c3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:34.468976 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-547936ac-5483-48ee-a0a5-cb21cdef98c3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:34.550486 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-8b5ccb1c-0975-4e6d-a086-79ba02e35690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:34.551099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-8b5ccb1c-0975-4e6d-a086-79ba02e35690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:34.559214 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb1c-0975-4e6d-a086-79ba02e35690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:34.559676 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb1c-0975-4e6d-a086-79ba02e35690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:34.560514 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb1c-0975-4e6d-a086-79ba02e35690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:34.560941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb1c-0975-4e6d-a086-79ba02e35690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:34.597950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-547936ac-5483-48ee-a0a5-cb21cdef98c3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:34.606770 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-547936ac-5483-48ee-a0a5-cb21cdef98c3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:34.608284 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-547936ac-5483-48ee-a0a5-cb21cdef98c3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:34.609447 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-547936ac-5483-48ee-a0a5-cb21cdef98c3 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.154093 Oct 28 08:51:34.610037 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 680/1413] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:34 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:34.695124 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-8b5ccb1c-0975-4e6d-a086-79ba02e35690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:34.702309 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-8b5ccb1c-0975-4e6d-a086-79ba02e35690 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.155447 Oct 28 08:51:34.702986 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 734/1414] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:34 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:35.627977 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3cd9e276-466f-4ad4-9618-a8b5515ca6b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:35.628522 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3cd9e276-466f-4ad4-9618-a8b5515ca6b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:35.635349 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3cd9e276-466f-4ad4-9618-a8b5515ca6b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:35.635797 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3cd9e276-466f-4ad4-9618-a8b5515ca6b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:35.636558 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3cd9e276-466f-4ad4-9618-a8b5515ca6b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:35.637000 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3cd9e276-466f-4ad4-9618-a8b5515ca6b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:35.719975 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fb0dfbfe-cce9-4d9a-b70c-ad12e50000f7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:35.720798 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fb0dfbfe-cce9-4d9a-b70c-ad12e50000f7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:35.728386 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb0dfbfe-cce9-4d9a-b70c-ad12e50000f7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:35.729316 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb0dfbfe-cce9-4d9a-b70c-ad12e50000f7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:35.730125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb0dfbfe-cce9-4d9a-b70c-ad12e50000f7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:35.730562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fb0dfbfe-cce9-4d9a-b70c-ad12e50000f7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:35.814503 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3cd9e276-466f-4ad4-9618-a8b5515ca6b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:35.824020 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3cd9e276-466f-4ad4-9618-a8b5515ca6b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:35.825557 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3cd9e276-466f-4ad4-9618-a8b5515ca6b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:35.826773 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3cd9e276-466f-4ad4-9618-a8b5515ca6b9 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.202641 Oct 28 08:51:35.827342 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 681/1415] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:35 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:35.893560 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fb0dfbfe-cce9-4d9a-b70c-ad12e50000f7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:35.901272 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fb0dfbfe-cce9-4d9a-b70c-ad12e50000f7 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.186828 Oct 28 08:51:35.901860 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 735/1416] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:35 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:36.845574 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-839af987-ab60-4d5f-a117-da4775cf9a0b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:36.846210 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-839af987-ab60-4d5f-a117-da4775cf9a0b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:36.854144 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-839af987-ab60-4d5f-a117-da4775cf9a0b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:36.854602 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-839af987-ab60-4d5f-a117-da4775cf9a0b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:36.855455 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-839af987-ab60-4d5f-a117-da4775cf9a0b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:36.855830 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-839af987-ab60-4d5f-a117-da4775cf9a0b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:36.920092 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fc479159-1908-47a6-b73c-f9ffbc815752 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:36.921028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fc479159-1908-47a6-b73c-f9ffbc815752 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:36.928047 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fc479159-1908-47a6-b73c-f9ffbc815752 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:36.928495 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fc479159-1908-47a6-b73c-f9ffbc815752 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:36.930283 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fc479159-1908-47a6-b73c-f9ffbc815752 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:36.930724 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fc479159-1908-47a6-b73c-f9ffbc815752 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:37.040574 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-839af987-ab60-4d5f-a117-da4775cf9a0b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:37.049417 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-839af987-ab60-4d5f-a117-da4775cf9a0b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:37.051275 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-839af987-ab60-4d5f-a117-da4775cf9a0b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:37.052687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-839af987-ab60-4d5f-a117-da4775cf9a0b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.211395 Oct 28 08:51:37.054365 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 682/1417] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:36 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:37.105618 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fc479159-1908-47a6-b73c-f9ffbc815752 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:37.113673 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fc479159-1908-47a6-b73c-f9ffbc815752 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.198076 Oct 28 08:51:37.114585 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 736/1418] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:36 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:38.074554 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a6821658-926c-408b-9ff6-ec95fd943415 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:38.075332 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a6821658-926c-408b-9ff6-ec95fd943415 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:38.081437 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6821658-926c-408b-9ff6-ec95fd943415 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:38.081833 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6821658-926c-408b-9ff6-ec95fd943415 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:38.082618 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6821658-926c-408b-9ff6-ec95fd943415 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:38.083073 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a6821658-926c-408b-9ff6-ec95fd943415 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:38.138949 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-246974b8-d42b-4865-8483-082de34e4398 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:38.139711 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-246974b8-d42b-4865-8483-082de34e4398 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:38.146097 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-246974b8-d42b-4865-8483-082de34e4398 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:38.146803 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-246974b8-d42b-4865-8483-082de34e4398 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:38.147957 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-246974b8-d42b-4865-8483-082de34e4398 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:38.148756 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-246974b8-d42b-4865-8483-082de34e4398 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:38.251533 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a6821658-926c-408b-9ff6-ec95fd943415 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:38.259990 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a6821658-926c-408b-9ff6-ec95fd943415 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:38.261744 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a6821658-926c-408b-9ff6-ec95fd943415 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:38.262989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a6821658-926c-408b-9ff6-ec95fd943415 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.192580 Oct 28 08:51:38.263726 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 683/1419] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:38 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:38.311655 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-246974b8-d42b-4865-8483-082de34e4398 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:38.319181 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-246974b8-d42b-4865-8483-082de34e4398 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.184008 Oct 28 08:51:38.319804 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 737/1420] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:38 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:38.551011 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-e8498ab8-0bbe-4732-a92f-abbf99bab904 req-078eccb1-19d6-4593-b8b7-1b3d0db20e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44471d5a-b894-4e3f-b59d-b03afd03839b", "name": "network-vif-plugged", "status": "completed", "tag": "21594cc8-c73a-42e8-9350-519f7620496e"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:38.552554 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:51:38.552554 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:51:38.562108 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-e8498ab8-0bbe-4732-a92f-abbf99bab904 req-078eccb1-19d6-4593-b8b7-1b3d0db20e6c service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:38.562673 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-e8498ab8-0bbe-4732-a92f-abbf99bab904 req-078eccb1-19d6-4593-b8b7-1b3d0db20e6c service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:38.577201 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-e8498ab8-0bbe-4732-a92f-abbf99bab904 req-078eccb1-19d6-4593-b8b7-1b3d0db20e6c service nova] Creating event network-vif-plugged:21594cc8-c73a-42e8-9350-519f7620496e for instance 44471d5a-b894-4e3f-b59d-b03afd03839b on hv-cinder-81566 Oct 28 08:51:38.583293 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-e8498ab8-0bbe-4732-a92f-abbf99bab904 req-078eccb1-19d6-4593-b8b7-1b3d0db20e6c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036214 Oct 28 08:51:38.584416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 684/1421] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:51:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:51:39.281137 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-991b2d19-1cd0-46e4-b8cc-28b211ae6306 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:39.281739 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-991b2d19-1cd0-46e4-b8cc-28b211ae6306 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:39.287748 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-991b2d19-1cd0-46e4-b8cc-28b211ae6306 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:39.288261 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-991b2d19-1cd0-46e4-b8cc-28b211ae6306 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:39.289091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-991b2d19-1cd0-46e4-b8cc-28b211ae6306 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:39.289523 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-991b2d19-1cd0-46e4-b8cc-28b211ae6306 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:39.337483 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-857f4500-f7db-44d9-b7f0-f79cfe9bbfd3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:39.338857 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-857f4500-f7db-44d9-b7f0-f79cfe9bbfd3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:39.345114 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-857f4500-f7db-44d9-b7f0-f79cfe9bbfd3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:39.345559 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-857f4500-f7db-44d9-b7f0-f79cfe9bbfd3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:39.346347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-857f4500-f7db-44d9-b7f0-f79cfe9bbfd3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:39.347016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-857f4500-f7db-44d9-b7f0-f79cfe9bbfd3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:39.455687 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-991b2d19-1cd0-46e4-b8cc-28b211ae6306 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:39.464750 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-991b2d19-1cd0-46e4-b8cc-28b211ae6306 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:39.466331 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-991b2d19-1cd0-46e4-b8cc-28b211ae6306 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:39.467499 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-991b2d19-1cd0-46e4-b8cc-28b211ae6306 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.190305 Oct 28 08:51:39.468071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 738/1422] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:39 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:39.514719 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-857f4500-f7db-44d9-b7f0-f79cfe9bbfd3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:39.522157 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-857f4500-f7db-44d9-b7f0-f79cfe9bbfd3 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.189282 Oct 28 08:51:39.522695 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 685/1423] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:39 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:40.496178 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9842708b-41cb-4c2b-8c62-bbfada5d7210 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:40.496851 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9842708b-41cb-4c2b-8c62-bbfada5d7210 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:40.503186 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9842708b-41cb-4c2b-8c62-bbfada5d7210 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:40.503630 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9842708b-41cb-4c2b-8c62-bbfada5d7210 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:40.504399 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9842708b-41cb-4c2b-8c62-bbfada5d7210 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:40.504835 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9842708b-41cb-4c2b-8c62-bbfada5d7210 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:40.539378 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3db16bf6-3cf1-42e9-b352-8c1081569c69 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:40.540106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3db16bf6-3cf1-42e9-b352-8c1081569c69 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:40.547063 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3db16bf6-3cf1-42e9-b352-8c1081569c69 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:40.547495 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3db16bf6-3cf1-42e9-b352-8c1081569c69 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:40.548480 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3db16bf6-3cf1-42e9-b352-8c1081569c69 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:40.548907 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3db16bf6-3cf1-42e9-b352-8c1081569c69 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:40.664768 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9842708b-41cb-4c2b-8c62-bbfada5d7210 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:40.685922 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9842708b-41cb-4c2b-8c62-bbfada5d7210 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:40.688525 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9842708b-41cb-4c2b-8c62-bbfada5d7210 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:40.689738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9842708b-41cb-4c2b-8c62-bbfada5d7210 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1729 microversion: 2.20 time: 0.198505 Oct 28 08:51:40.690344 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 739/1424] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:40 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:40.719564 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3db16bf6-3cf1-42e9-b352-8c1081569c69 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:40.728274 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3db16bf6-3cf1-42e9-b352-8c1081569c69 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.192881 Oct 28 08:51:40.728960 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 686/1425] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:40 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:41.708373 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bc62e453-5e05-4c8d-ab65-162203b6282f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:41.708997 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bc62e453-5e05-4c8d-ab65-162203b6282f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:41.715325 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bc62e453-5e05-4c8d-ab65-162203b6282f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:41.715766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bc62e453-5e05-4c8d-ab65-162203b6282f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:41.716531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bc62e453-5e05-4c8d-ab65-162203b6282f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:41.716961 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bc62e453-5e05-4c8d-ab65-162203b6282f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:41.750392 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ecfb0fba-d635-40e4-a5c4-1d435ed1d229 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:41.751087 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ecfb0fba-d635-40e4-a5c4-1d435ed1d229 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:41.758480 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ecfb0fba-d635-40e4-a5c4-1d435ed1d229 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:41.758919 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ecfb0fba-d635-40e4-a5c4-1d435ed1d229 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:41.759729 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ecfb0fba-d635-40e4-a5c4-1d435ed1d229 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:41.760156 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ecfb0fba-d635-40e4-a5c4-1d435ed1d229 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:41.873704 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-bc62e453-5e05-4c8d-ab65-162203b6282f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:41.887802 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-bc62e453-5e05-4c8d-ab65-162203b6282f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:41.889341 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-bc62e453-5e05-4c8d-ab65-162203b6282f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:41.890555 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bc62e453-5e05-4c8d-ab65-162203b6282f tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1716 microversion: 2.20 time: 0.185984 Oct 28 08:51:41.891296 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 740/1426] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:41 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1716 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:41.925018 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ecfb0fba-d635-40e4-a5c4-1d435ed1d229 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:41.934319 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ecfb0fba-d635-40e4-a5c4-1d435ed1d229 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.187298 Oct 28 08:51:41.934932 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 687/1427] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:41 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:42.951755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0da24808-adb5-4941-9625-8804be8fba41 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:42.952384 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0da24808-adb5-4941-9625-8804be8fba41 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:42.958919 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0da24808-adb5-4941-9625-8804be8fba41 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:42.959383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0da24808-adb5-4941-9625-8804be8fba41 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:42.960122 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0da24808-adb5-4941-9625-8804be8fba41 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:42.961208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0da24808-adb5-4941-9625-8804be8fba41 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:43.110394 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0da24808-adb5-4941-9625-8804be8fba41 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:43.120072 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0da24808-adb5-4941-9625-8804be8fba41 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.172234 Oct 28 08:51:43.121087 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 741/1428] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:42 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:44.139241 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d65b2220-e9b4-4936-adcb-ce4a19730207 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:44.139851 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d65b2220-e9b4-4936-adcb-ce4a19730207 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:44.146244 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d65b2220-e9b4-4936-adcb-ce4a19730207 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:44.146795 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d65b2220-e9b4-4936-adcb-ce4a19730207 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:44.148215 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d65b2220-e9b4-4936-adcb-ce4a19730207 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:44.148410 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d65b2220-e9b4-4936-adcb-ce4a19730207 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:44.281415 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-d65b2220-e9b4-4936-adcb-ce4a19730207 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:44.294984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d65b2220-e9b4-4936-adcb-ce4a19730207 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.159447 Oct 28 08:51:44.295811 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 688/1429] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:44 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:44.586888 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-47750fb4-e5f3-4b36-8953-fc45114f6c67 req-d1793bd0-4bac-4ff0-b21e-abb9f8368561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1", "name": "network-vif-plugged", "status": "completed", "tag": "0151d785-b8a4-4437-9aa9-d788de11dd43"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:44.589223 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:51:44.589223 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:51:44.597094 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-47750fb4-e5f3-4b36-8953-fc45114f6c67 req-d1793bd0-4bac-4ff0-b21e-abb9f8368561 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:44.597535 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-47750fb4-e5f3-4b36-8953-fc45114f6c67 req-d1793bd0-4bac-4ff0-b21e-abb9f8368561 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:44.610903 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-47750fb4-e5f3-4b36-8953-fc45114f6c67 req-d1793bd0-4bac-4ff0-b21e-abb9f8368561 service nova] Creating event network-vif-plugged:0151d785-b8a4-4437-9aa9-d788de11dd43 for instance d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 on hv-cinder-81566 Oct 28 08:51:44.615973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-47750fb4-e5f3-4b36-8953-fc45114f6c67 req-d1793bd0-4bac-4ff0-b21e-abb9f8368561 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033831 Oct 28 08:51:44.617112 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 742/1430] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:51:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:51:45.312222 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e17b845d-c3be-40ea-b287-f82ce079595f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:45.313044 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e17b845d-c3be-40ea-b287-f82ce079595f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:45.321010 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e17b845d-c3be-40ea-b287-f82ce079595f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:45.321535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e17b845d-c3be-40ea-b287-f82ce079595f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:45.322400 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e17b845d-c3be-40ea-b287-f82ce079595f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:45.322924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e17b845d-c3be-40ea-b287-f82ce079595f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:45.461621 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e17b845d-c3be-40ea-b287-f82ce079595f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:45.469045 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e17b845d-c3be-40ea-b287-f82ce079595f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1576 microversion: 2.1 time: 0.160457 Oct 28 08:51:45.469607 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 689/1431] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:45 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:46.486483 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9f29d08c-68e9-46e8-a854-f713e322ce07 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:46.487178 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9f29d08c-68e9-46e8-a854-f713e322ce07 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:46.494281 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f29d08c-68e9-46e8-a854-f713e322ce07 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:46.494722 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f29d08c-68e9-46e8-a854-f713e322ce07 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:46.495694 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f29d08c-68e9-46e8-a854-f713e322ce07 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:46.496120 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9f29d08c-68e9-46e8-a854-f713e322ce07 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:46.641522 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9f29d08c-68e9-46e8-a854-f713e322ce07 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:46.650552 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9f29d08c-68e9-46e8-a854-f713e322ce07 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1563 microversion: 2.1 time: 0.168777 Oct 28 08:51:46.651253 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 743/1432] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:46 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:50.424892 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-28b0a16e-8ea2-4b7c-ad62-79dd608d489f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:50.425499 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-28b0a16e-8ea2-4b7c-ad62-79dd608d489f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:50.433231 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-28b0a16e-8ea2-4b7c-ad62-79dd608d489f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:50.433638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-28b0a16e-8ea2-4b7c-ad62-79dd608d489f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:50.434449 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-28b0a16e-8ea2-4b7c-ad62-79dd608d489f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:50.434881 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-28b0a16e-8ea2-4b7c-ad62-79dd608d489f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:50.460353 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-28b0a16e-8ea2-4b7c-ad62-79dd608d489f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:52:50.552092 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-28b0a16e-8ea2-4b7c-ad62-79dd608d489f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "DELETE /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 204 len: 0 microversion: 2.1 time: 0.131654 Oct 28 08:52:50.553779 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 690/1433] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:52:50 2021] DELETE /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:52:50.562362 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-728e359d-6ed8-484a-94b5-23cc2c04a70b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:50.563197 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-728e359d-6ed8-484a-94b5-23cc2c04a70b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:50.576908 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-728e359d-6ed8-484a-94b5-23cc2c04a70b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:50.577427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-728e359d-6ed8-484a-94b5-23cc2c04a70b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:50.578319 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-728e359d-6ed8-484a-94b5-23cc2c04a70b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:50.582161 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-728e359d-6ed8-484a-94b5-23cc2c04a70b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:50.584825 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-d5ddd44a-9232-4db4-b724-595b3f770b07 req-f6dacf77-f4ea-45cf-b67c-9604a200b460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98", "tag": "58fe07ec-e0d5-48c7-a254-bcaf6285fb85"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:50.586718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:52:50.586718 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:52:50.594018 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-d5ddd44a-9232-4db4-b724-595b3f770b07 req-f6dacf77-f4ea-45cf-b67c-9604a200b460 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:50.594755 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-d5ddd44a-9232-4db4-b724-595b3f770b07 req-f6dacf77-f4ea-45cf-b67c-9604a200b460 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:50.606897 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-d5ddd44a-9232-4db4-b724-595b3f770b07 req-f6dacf77-f4ea-45cf-b67c-9604a200b460 service nova] Creating event network-changed:58fe07ec-e0d5-48c7-a254-bcaf6285fb85 for instance dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 on hv-cinder-81566 Oct 28 08:52:50.612147 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-d5ddd44a-9232-4db4-b724-595b3f770b07 req-f6dacf77-f4ea-45cf-b67c-9604a200b460 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189493 Oct 28 08:52:50.612921 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 744/1434] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:52:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:52:50.814052 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-728e359d-6ed8-484a-94b5-23cc2c04a70b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:50.823366 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-728e359d-6ed8-484a-94b5-23cc2c04a70b tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1574 microversion: 2.1 time: 0.265185 Oct 28 08:52:50.824021 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 691/1435] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:50 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1574 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:52:51.847942 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ce7e9de3-8d3f-450c-8eb2-f4d0bc1efbd8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:51.848554 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ce7e9de3-8d3f-450c-8eb2-f4d0bc1efbd8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:51.854829 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ce7e9de3-8d3f-450c-8eb2-f4d0bc1efbd8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:51.855276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ce7e9de3-8d3f-450c-8eb2-f4d0bc1efbd8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:51.856040 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ce7e9de3-8d3f-450c-8eb2-f4d0bc1efbd8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:51.856476 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ce7e9de3-8d3f-450c-8eb2-f4d0bc1efbd8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:51.986377 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-ce7e9de3-8d3f-450c-8eb2-f4d0bc1efbd8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:51.994351 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ce7e9de3-8d3f-450c-8eb2-f4d0bc1efbd8 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1456 microversion: 2.1 time: 0.151109 Oct 28 08:52:51.994933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 745/1436] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:51 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1456 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:53.012040 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-020c24c0-1d73-4cdd-a773-3515000f1a59 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:53.012656 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-020c24c0-1d73-4cdd-a773-3515000f1a59 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:53.019518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-020c24c0-1d73-4cdd-a773-3515000f1a59 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:53.019998 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-020c24c0-1d73-4cdd-a773-3515000f1a59 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:53.020837 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-020c24c0-1d73-4cdd-a773-3515000f1a59 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:53.021270 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-020c24c0-1d73-4cdd-a773-3515000f1a59 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:53.256821 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-020c24c0-1d73-4cdd-a773-3515000f1a59 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:53.267286 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-020c24c0-1d73-4cdd-a773-3515000f1a59 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1456 microversion: 2.1 time: 0.259023 Oct 28 08:52:53.267877 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 692/1437] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:53 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1456 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:53.501273 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-07d6dbdf-90d8-450d-b45a-42fda2c8d363 req-35dd8eb8-fa72-4c93-a826-14d404516cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98", "name": "network-vif-deleted", "tag": "58fe07ec-e0d5-48c7-a254-bcaf6285fb85"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:53.502806 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:52:53.502806 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:52:53.510846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-07d6dbdf-90d8-450d-b45a-42fda2c8d363 req-35dd8eb8-fa72-4c93-a826-14d404516cbb service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:53.511496 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-07d6dbdf-90d8-450d-b45a-42fda2c8d363 req-35dd8eb8-fa72-4c93-a826-14d404516cbb service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:53.530092 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-07d6dbdf-90d8-450d-b45a-42fda2c8d363 req-35dd8eb8-fa72-4c93-a826-14d404516cbb service nova] Creating event network-vif-deleted:58fe07ec-e0d5-48c7-a254-bcaf6285fb85 for instance dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 on hv-cinder-81566 Oct 28 08:52:53.536245 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-07d6dbdf-90d8-450d-b45a-42fda2c8d363 req-35dd8eb8-fa72-4c93-a826-14d404516cbb service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038102 Oct 28 08:52:53.538736 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 746/1438] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:52:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:52:54.293048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:54.293684 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:54.300281 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:54.300733 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:54.301557 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:54.302078 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:54.334880 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:54.335328 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:54.335793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.objects.instance [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lazy-loading 'fault' on Instance uuid dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 {{(pid=132796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:52:54.376219 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:54.385736 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-db87a44e-f549-475c-b3c1-d25bbfc26753 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 200 len: 1228 microversion: 2.1 time: 0.096766 Oct 28 08:52:54.386341 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 693/1439] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:54 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:55.403986 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-03e791e9-17cc-438f-b294-0a37b698d91e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:55.404687 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-03e791e9-17cc-438f-b294-0a37b698d91e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:55.410855 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03e791e9-17cc-438f-b294-0a37b698d91e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:55.411354 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03e791e9-17cc-438f-b294-0a37b698d91e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:55.412355 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03e791e9-17cc-438f-b294-0a37b698d91e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:55.412793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03e791e9-17cc-438f-b294-0a37b698d91e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:55.427497 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-03e791e9-17cc-438f-b294-0a37b698d91e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] HTTP exception thrown: Instance dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 could not be found. Oct 28 08:52:55.428098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-03e791e9-17cc-438f-b294-0a37b698d91e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Returning 404 to user: Instance dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:52:55.428973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-03e791e9-17cc-438f-b294-0a37b698d91e tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98" status: 404 len: 111 microversion: 2.1 time: 0.029682 Oct 28 08:52:55.429542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 747/1440] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:55 2021] GET /compute/v2.1/servers/dba19f7c-dd58-44ad-9bc7-f0e2ee3e3b98 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:52:58.579926 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9da7aa6b-0d77-4e60-90e1-197c0bb0cbb9 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:58.580419 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9da7aa6b-0d77-4e60-90e1-197c0bb0cbb9 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:58.584785 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-0dbdad08-12e5-4b3a-82b7-d6172d30ab87 req-3414e305-29b2-4d39-99a8-10b39e2b6eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e1be19-0a03-4c39-a83c-6003d4bd42d3", "tag": "fc95f307-8716-45cd-991e-6a984816ab3c"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:58.586771 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:52:58.586771 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:52:58.587856 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9da7aa6b-0d77-4e60-90e1-197c0bb0cbb9 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:58.588305 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9da7aa6b-0d77-4e60-90e1-197c0bb0cbb9 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:58.589082 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9da7aa6b-0d77-4e60-90e1-197c0bb0cbb9 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:58.589743 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9da7aa6b-0d77-4e60-90e1-197c0bb0cbb9 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:58.594787 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-0dbdad08-12e5-4b3a-82b7-d6172d30ab87 req-3414e305-29b2-4d39-99a8-10b39e2b6eb5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:58.595221 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-0dbdad08-12e5-4b3a-82b7-d6172d30ab87 req-3414e305-29b2-4d39-99a8-10b39e2b6eb5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:58.607183 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-0dbdad08-12e5-4b3a-82b7-d6172d30ab87 req-3414e305-29b2-4d39-99a8-10b39e2b6eb5 service nova] Creating event network-changed:fc95f307-8716-45cd-991e-6a984816ab3c for instance 82e1be19-0a03-4c39-a83c-6003d4bd42d3 on hv-cinder-81566 Oct 28 08:52:58.612379 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-0dbdad08-12e5-4b3a-82b7-d6172d30ab87 req-3414e305-29b2-4d39-99a8-10b39e2b6eb5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032384 Oct 28 08:52:58.612973 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 748/1441] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:52:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:52:58.618554 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9da7aa6b-0d77-4e60-90e1-197c0bb0cbb9 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:52:58.723199 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9da7aa6b-0d77-4e60-90e1-197c0bb0cbb9 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "DELETE /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 204 len: 0 microversion: 2.1 time: 0.146391 Oct 28 08:52:58.724402 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 694/1442] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:52:58 2021] DELETE /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:52:58.733077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-16eec83e-9905-4f46-b687-f61c545a78a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:58.733779 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-16eec83e-9905-4f46-b687-f61c545a78a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:58.740475 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-16eec83e-9905-4f46-b687-f61c545a78a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:58.740928 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-16eec83e-9905-4f46-b687-f61c545a78a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:58.747279 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-16eec83e-9905-4f46-b687-f61c545a78a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:58.747279 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-16eec83e-9905-4f46-b687-f61c545a78a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:58.961030 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-16eec83e-9905-4f46-b687-f61c545a78a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:58.969239 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-16eec83e-9905-4f46-b687-f61c545a78a4 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1576 microversion: 2.1 time: 0.240165 Oct 28 08:52:58.969858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 749/1443] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:58 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:59.989844 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a4e84600-c5ae-41f3-bddc-78eab6165605 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:59.990638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a4e84600-c5ae-41f3-bddc-78eab6165605 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:59.997312 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4e84600-c5ae-41f3-bddc-78eab6165605 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:59.997761 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4e84600-c5ae-41f3-bddc-78eab6165605 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:59.998625 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4e84600-c5ae-41f3-bddc-78eab6165605 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:59.999069 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4e84600-c5ae-41f3-bddc-78eab6165605 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:00.093106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-a4e84600-c5ae-41f3-bddc-78eab6165605 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c731f20a04204d9ea0b04a20f2e72577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8be4e851fc4c5bb989b23068ab50b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:00.101808 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a4e84600-c5ae-41f3-bddc-78eab6165605 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 200 len: 1390 microversion: 2.1 time: 0.118292 Oct 28 08:53:00.102746 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 695/1444] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:59 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 1390 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:00.628157 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-b4192afd-aff9-4f47-ae3b-360a915a37fe req-d42070ff-846a-4444-8031-ff7de1651399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e1be19-0a03-4c39-a83c-6003d4bd42d3", "name": "network-vif-deleted", "tag": "fc95f307-8716-45cd-991e-6a984816ab3c"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:00.630393 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:00.630393 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:53:00.637693 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-b4192afd-aff9-4f47-ae3b-360a915a37fe req-d42070ff-846a-4444-8031-ff7de1651399 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:00.638177 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-b4192afd-aff9-4f47-ae3b-360a915a37fe req-d42070ff-846a-4444-8031-ff7de1651399 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:00.649144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-b4192afd-aff9-4f47-ae3b-360a915a37fe req-d42070ff-846a-4444-8031-ff7de1651399 service nova] Creating event network-vif-deleted:fc95f307-8716-45cd-991e-6a984816ab3c for instance 82e1be19-0a03-4c39-a83c-6003d4bd42d3 on hv-cinder-81566 Oct 28 08:53:00.654019 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-b4192afd-aff9-4f47-ae3b-360a915a37fe req-d42070ff-846a-4444-8031-ff7de1651399 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029560 Oct 28 08:53:00.654623 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 750/1445] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:53:01.120367 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e3558987-27aa-492e-8430-064abd72591f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:01.120973 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e3558987-27aa-492e-8430-064abd72591f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 82e1be19-0a03-4c39-a83c-6003d4bd42d3] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:01.127249 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3558987-27aa-492e-8430-064abd72591f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:01.127702 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3558987-27aa-492e-8430-064abd72591f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:01.128467 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3558987-27aa-492e-8430-064abd72591f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:01.128905 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e3558987-27aa-492e-8430-064abd72591f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:01.144431 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-e3558987-27aa-492e-8430-064abd72591f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] HTTP exception thrown: Instance 82e1be19-0a03-4c39-a83c-6003d4bd42d3 could not be found. Oct 28 08:53:01.145048 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e3558987-27aa-492e-8430-064abd72591f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Returning 404 to user: Instance 82e1be19-0a03-4c39-a83c-6003d4bd42d3 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:53:01.146952 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e3558987-27aa-492e-8430-064abd72591f tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3" status: 404 len: 111 microversion: 2.1 time: 0.030346 Oct 28 08:53:01.147529 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 696/1446] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:01 2021] GET /compute/v2.1/servers/82e1be19-0a03-4c39-a83c-6003d4bd42d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:53:01.622781 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4d149668-7482-4163-9ca8-fc1af2d66944 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:01.623372 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4d149668-7482-4163-9ca8-fc1af2d66944 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:01.630474 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4d149668-7482-4163-9ca8-fc1af2d66944 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:01.631071 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4d149668-7482-4163-9ca8-fc1af2d66944 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:01.631627 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4d149668-7482-4163-9ca8-fc1af2d66944 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:01.632063 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-4d149668-7482-4163-9ca8-fc1af2d66944 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:01.646636 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-4d149668-7482-4163-9ca8-fc1af2d66944 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] HTTP exception thrown: Instance 5d1aa424-5de3-486c-af93-d2e0b411fa1a could not be found. Oct 28 08:53:01.647270 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4d149668-7482-4163-9ca8-fc1af2d66944 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Returning 404 to user: Instance 5d1aa424-5de3-486c-af93-d2e0b411fa1a could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:53:01.648111 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4d149668-7482-4163-9ca8-fc1af2d66944 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "DELETE /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 404 len: 111 microversion: 2.1 time: 0.029430 Oct 28 08:53:01.648671 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 751/1447] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:53:01 2021] DELETE /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:53:01.656638 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6ef09b75-9135-4931-bf1f-00cd60268a3a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:01.657297 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6ef09b75-9135-4931-bf1f-00cd60268a3a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [instance: 5d1aa424-5de3-486c-af93-d2e0b411fa1a] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:01.663657 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6ef09b75-9135-4931-bf1f-00cd60268a3a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:01.664104 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6ef09b75-9135-4931-bf1f-00cd60268a3a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:01.664931 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6ef09b75-9135-4931-bf1f-00cd60268a3a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:01.665619 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6ef09b75-9135-4931-bf1f-00cd60268a3a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:01.680029 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-6ef09b75-9135-4931-bf1f-00cd60268a3a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] HTTP exception thrown: Instance 5d1aa424-5de3-486c-af93-d2e0b411fa1a could not be found. Oct 28 08:53:01.680627 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6ef09b75-9135-4931-bf1f-00cd60268a3a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Returning 404 to user: Instance 5d1aa424-5de3-486c-af93-d2e0b411fa1a could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:53:01.681471 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6ef09b75-9135-4931-bf1f-00cd60268a3a tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a" status: 404 len: 111 microversion: 2.1 time: 0.028567 Oct 28 08:53:01.682269 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 697/1448] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:01 2021] GET /compute/v2.1/servers/5d1aa424-5de3-486c-af93-d2e0b411fa1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:53:03.232664 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5d2ff820-56e9-4c25-a796-f5666c4b1fd7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] Calling method '.version_select at 0x7f9e6befc4c0>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:03.236225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d2ff820-56e9-4c25-a796-f5666c4b1fd7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [f61e705c-1362-41bf-82f0-351f9bc17b79] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 08:53:04.257397 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d2ff820-56e9-4c25-a796-f5666c4b1fd7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] [f61e705c-1362-41bf-82f0-351f9bc17b79] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 47032. Oct 28 08:53:04.278163 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5d2ff820-56e9-4c25-a796-f5666c4b1fd7 tempest-TestVolumeBootPattern-448221190 tempest-TestVolumeBootPattern-448221190-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-21201921" status: 202 len: 0 microversion: 2.1 time: 1.049460 Oct 28 08:53:04.278756 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 752/1449] 10.222.0.74 () {58 vars in 1256 bytes} [Thu Oct 28 08:53:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-21201921 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:53:19.151639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d9b0e382-c3fe-4ff3-85a0-4f970d354a7b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:19.152598 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d9b0e382-c3fe-4ff3-85a0-4f970d354a7b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:19.158531 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9b0e382-c3fe-4ff3-85a0-4f970d354a7b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:19.158973 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9b0e382-c3fe-4ff3-85a0-4f970d354a7b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:19.159730 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9b0e382-c3fe-4ff3-85a0-4f970d354a7b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:19.160769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d9b0e382-c3fe-4ff3-85a0-4f970d354a7b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:19.189466 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d9b0e382-c3fe-4ff3-85a0-4f970d354a7b tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041774 Oct 28 08:53:19.190094 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 698/1450] 10.222.0.74 () {60 vars in 1342 bytes} [Thu Oct 28 08:53:19 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:19.246072 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d9d5b86c-c979-4591-854e-784b4d1c7a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:19.246674 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d9d5b86c-c979-4591-854e-784b4d1c7a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:19.252977 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d9d5b86c-c979-4591-854e-784b4d1c7a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:19.253423 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d9d5b86c-c979-4591-854e-784b4d1c7a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:19.254269 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d9d5b86c-c979-4591-854e-784b4d1c7a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:19.254699 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d9d5b86c-c979-4591-854e-784b4d1c7a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:19.280308 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d9d5b86c-c979-4591-854e-784b4d1c7a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Going to try to terminate instance {{(pid=132797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:53:19.363451 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d9d5b86c-c979-4591-854e-784b4d1c7a42 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 204 len: 0 microversion: 2.20 time: 0.121335 Oct 28 08:53:19.363974 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 753/1451] 10.222.0.74 () {60 vars in 1279 bytes} [Thu Oct 28 08:53:19 2021] DELETE /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:53:19.372039 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b1dc4c53-2bf9-41dc-9861-41f3f8d77708 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:19.372639 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b1dc4c53-2bf9-41dc-9861-41f3f8d77708 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:19.379229 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b1dc4c53-2bf9-41dc-9861-41f3f8d77708 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:19.379776 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b1dc4c53-2bf9-41dc-9861-41f3f8d77708 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:19.380546 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b1dc4c53-2bf9-41dc-9861-41f3f8d77708 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:19.380982 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b1dc4c53-2bf9-41dc-9861-41f3f8d77708 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:19.517516 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b1dc4c53-2bf9-41dc-9861-41f3f8d77708 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:19.526068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b1dc4c53-2bf9-41dc-9861-41f3f8d77708 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:19.527555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b1dc4c53-2bf9-41dc-9861-41f3f8d77708 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:19.528712 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b1dc4c53-2bf9-41dc-9861-41f3f8d77708 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.160467 Oct 28 08:53:19.529262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 699/1452] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:53:19 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:53:20.468039 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:53:20.468742 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: Thu Oct 28 08:53:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:53:20.547101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3fe6db8e-5ab8-4505-b6fd-49d375510211 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:20.547807 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3fe6db8e-5ab8-4505-b6fd-49d375510211 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:20.555892 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3fe6db8e-5ab8-4505-b6fd-49d375510211 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:20.556337 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3fe6db8e-5ab8-4505-b6fd-49d375510211 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:20.557141 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3fe6db8e-5ab8-4505-b6fd-49d375510211 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:20.557577 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3fe6db8e-5ab8-4505-b6fd-49d375510211 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:20.700925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3fe6db8e-5ab8-4505-b6fd-49d375510211 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:20.710070 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3fe6db8e-5ab8-4505-b6fd-49d375510211 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:20.711724 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3fe6db8e-5ab8-4505-b6fd-49d375510211 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:20.712964 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3fe6db8e-5ab8-4505-b6fd-49d375510211 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1722 microversion: 2.20 time: 0.169936 Oct 28 08:53:20.713555 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 754/1453] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:53:20 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:53:21.732571 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9e5a8b7d-e058-445d-ada8-5a0d9a94548d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:21.733121 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9e5a8b7d-e058-445d-ada8-5a0d9a94548d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:21.740925 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9e5a8b7d-e058-445d-ada8-5a0d9a94548d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:21.741374 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9e5a8b7d-e058-445d-ada8-5a0d9a94548d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:21.742198 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9e5a8b7d-e058-445d-ada8-5a0d9a94548d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:21.742634 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9e5a8b7d-e058-445d-ada8-5a0d9a94548d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:21.816319 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9e5a8b7d-e058-445d-ada8-5a0d9a94548d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:21.824339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9e5a8b7d-e058-445d-ada8-5a0d9a94548d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:21.825863 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9e5a8b7d-e058-445d-ada8-5a0d9a94548d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8ccd80f4552487583ff9076adab3b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7a189da1ab4c96a271af47ac4baa62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:21.827027 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9e5a8b7d-e058-445d-ada8-5a0d9a94548d tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 200 len: 1655 microversion: 2.20 time: 0.098640 Oct 28 08:53:21.827574 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 700/1454] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:53:21 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 1655 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:53:21.993846 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-684b18ed-2429-49e5-be40-c8537b34fd84 req-e34eb3e4-debd-4796-a57e-141de3dcc02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44471d5a-b894-4e3f-b59d-b03afd03839b", "name": "network-vif-deleted", "tag": "21594cc8-c73a-42e8-9350-519f7620496e"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:21.995723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:21.995723 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:53:22.011249 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-684b18ed-2429-49e5-be40-c8537b34fd84 req-e34eb3e4-debd-4796-a57e-141de3dcc02f service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:22.013592 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-684b18ed-2429-49e5-be40-c8537b34fd84 req-e34eb3e4-debd-4796-a57e-141de3dcc02f service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:22.030658 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-684b18ed-2429-49e5-be40-c8537b34fd84 req-e34eb3e4-debd-4796-a57e-141de3dcc02f service nova] Creating event network-vif-deleted:21594cc8-c73a-42e8-9350-519f7620496e for instance 44471d5a-b894-4e3f-b59d-b03afd03839b on hv-cinder-81566 Oct 28 08:53:22.040915 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-684b18ed-2429-49e5-be40-c8537b34fd84 req-e34eb3e4-debd-4796-a57e-141de3dcc02f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050545 Oct 28 08:53:22.042212 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 755/1455] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:53:22.845544 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-614526a5-d1ad-4694-a75b-399febc6e699 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:22.846240 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-614526a5-d1ad-4694-a75b-399febc6e699 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:22.853018 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-614526a5-d1ad-4694-a75b-399febc6e699 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:22.853538 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-614526a5-d1ad-4694-a75b-399febc6e699 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:22.854269 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-614526a5-d1ad-4694-a75b-399febc6e699 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:22.854700 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-614526a5-d1ad-4694-a75b-399febc6e699 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:22.869115 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-614526a5-d1ad-4694-a75b-399febc6e699 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] HTTP exception thrown: Instance 44471d5a-b894-4e3f-b59d-b03afd03839b could not be found. Oct 28 08:53:22.869702 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-614526a5-d1ad-4694-a75b-399febc6e699 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Returning 404 to user: Instance 44471d5a-b894-4e3f-b59d-b03afd03839b could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:53:22.870575 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-614526a5-d1ad-4694-a75b-399febc6e699 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 404 len: 111 microversion: 2.20 time: 0.028814 Oct 28 08:53:22.871137 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 701/1456] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Oct 28 08:53:22 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:53:22.882053 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-16bc84f4-949a-4128-95a0-0a3e99cba843 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '.version_select at 0x7f9e6bddb8b0>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:22.906504 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-16bc84f4-949a-4128-95a0-0a3e99cba843 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133372109" status: 204 len: 0 microversion: 2.20 time: 0.029897 Oct 28 08:53:22.907192 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 756/1457] 10.222.0.74 () {60 vars in 1258 bytes} [Thu Oct 28 08:53:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133372109 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 08:53:24.791580 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ba8a0d83-017a-4270-8dbf-2c9f66adf51e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:24.792056 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ba8a0d83-017a-4270-8dbf-2c9f66adf51e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:24.798196 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ba8a0d83-017a-4270-8dbf-2c9f66adf51e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:24.798635 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ba8a0d83-017a-4270-8dbf-2c9f66adf51e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:24.799391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ba8a0d83-017a-4270-8dbf-2c9f66adf51e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:24.799817 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ba8a0d83-017a-4270-8dbf-2c9f66adf51e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:24.814036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-ba8a0d83-017a-4270-8dbf-2c9f66adf51e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] HTTP exception thrown: Instance 44471d5a-b894-4e3f-b59d-b03afd03839b could not be found. Oct 28 08:53:24.814630 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ba8a0d83-017a-4270-8dbf-2c9f66adf51e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Returning 404 to user: Instance 44471d5a-b894-4e3f-b59d-b03afd03839b could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:53:24.815461 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ba8a0d83-017a-4270-8dbf-2c9f66adf51e tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 404 len: 111 microversion: 2.1 time: 0.027807 Oct 28 08:53:24.816952 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 702/1458] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:53:24 2021] DELETE /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:53:24.825128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ac611351-15ab-4545-9702-0e40a96577fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:24.825879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ac611351-15ab-4545-9702-0e40a96577fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 44471d5a-b894-4e3f-b59d-b03afd03839b] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:24.832546 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac611351-15ab-4545-9702-0e40a96577fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:24.832993 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac611351-15ab-4545-9702-0e40a96577fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:24.833749 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac611351-15ab-4545-9702-0e40a96577fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:24.834199 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ac611351-15ab-4545-9702-0e40a96577fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:24.847571 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-ac611351-15ab-4545-9702-0e40a96577fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] HTTP exception thrown: Instance 44471d5a-b894-4e3f-b59d-b03afd03839b could not be found. Oct 28 08:53:24.848665 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ac611351-15ab-4545-9702-0e40a96577fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Returning 404 to user: Instance 44471d5a-b894-4e3f-b59d-b03afd03839b could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:53:24.849473 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ac611351-15ab-4545-9702-0e40a96577fe tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b" status: 404 len: 111 microversion: 2.1 time: 0.028530 Oct 28 08:53:24.850037 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 757/1459] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:24 2021] GET /compute/v2.1/servers/44471d5a-b894-4e3f-b59d-b03afd03839b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:53:25.992532 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-45668f5b-dd98-496f-9d25-bd0699f2003a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:25.993053 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-45668f5b-dd98-496f-9d25-bd0699f2003a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:25.998870 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45668f5b-dd98-496f-9d25-bd0699f2003a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:25.999255 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45668f5b-dd98-496f-9d25-bd0699f2003a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:26.000019 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45668f5b-dd98-496f-9d25-bd0699f2003a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:26.000451 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45668f5b-dd98-496f-9d25-bd0699f2003a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:26.017722 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-45668f5b-dd98-496f-9d25-bd0699f2003a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] HTTP exception thrown: Instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 could not be found. Oct 28 08:53:26.018590 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-45668f5b-dd98-496f-9d25-bd0699f2003a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Returning 404 to user: Instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:53:26.020765 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-45668f5b-dd98-496f-9d25-bd0699f2003a tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "DELETE /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 404 len: 111 microversion: 2.1 time: 0.032643 Oct 28 08:53:26.021658 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 703/1460] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:53:25 2021] DELETE /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:53:26.029961 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ec4c7fba-6b1d-4704-b52f-d6b1aeec2078 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:26.030570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-ec4c7fba-6b1d-4704-b52f-d6b1aeec2078 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] [instance: 423157c3-a1e9-43c5-8fda-01d1d93bd484] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:26.037700 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ec4c7fba-6b1d-4704-b52f-d6b1aeec2078 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:26.038171 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ec4c7fba-6b1d-4704-b52f-d6b1aeec2078 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:26.038937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ec4c7fba-6b1d-4704-b52f-d6b1aeec2078 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:26.039369 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-ec4c7fba-6b1d-4704-b52f-d6b1aeec2078 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:26.052809 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-ec4c7fba-6b1d-4704-b52f-d6b1aeec2078 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] HTTP exception thrown: Instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 could not be found. Oct 28 08:53:26.053391 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-ec4c7fba-6b1d-4704-b52f-d6b1aeec2078 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] Returning 404 to user: Instance 423157c3-a1e9-43c5-8fda-01d1d93bd484 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:53:26.054240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-ec4c7fba-6b1d-4704-b52f-d6b1aeec2078 tempest-AttachVolumeShelveTestJSON-795646418 tempest-AttachVolumeShelveTestJSON-795646418-project] 10.222.0.74 "GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484" status: 404 len: 111 microversion: 2.1 time: 0.028054 Oct 28 08:53:26.054803 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 758/1461] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:26 2021] GET /compute/v2.1/servers/423157c3-a1e9-43c5-8fda-01d1d93bd484 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:53:31.686486 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1585939686", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "networks": [{"uuid": "4ef62a40-86ce-4d50-abaa-404f56129ded"}]}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:31.744594 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] validate_networks() for [('4ef62a40-86ce-4d50-abaa-404f56129ded', None, None, None, None, None)] {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:53:32.178015 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:53:32.178436 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:53:32.178928 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:53:32.179334 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:53:32.179737 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:53:32.188432 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:32.188868 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:32.189665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:32.190126 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:32.205876 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Getting quotas for project 272e5ae4aa8045a38003e59b113e7898. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:53:32.210458 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Getting quotas for user d8ff8a38c0bd4f559355a124f8a0588c and project 272e5ae4aa8045a38003e59b113e7898. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:53:32.222320 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:53:32.224732 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:53:32.269922 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4465eedf-64de-4900-a391-f1c84eadc9d6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744111 Oct 28 08:53:32.270740 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 704/1462] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:53:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:53:32.280309 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2411e4d9-7d45-4105-8bd6-e8831e9e6021 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:32.280910 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2411e4d9-7d45-4105-8bd6-e8831e9e6021 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:32.341128 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2411e4d9-7d45-4105-8bd6-e8831e9e6021 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:32.348932 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2411e4d9-7d45-4105-8bd6-e8831e9e6021 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1218 microversion: 2.1 time: 0.072213 Oct 28 08:53:32.349568 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 759/1463] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:32 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:33.366727 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9a9e6d60-1b0a-4a18-90bc-b9031cadcfd5 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:33.367336 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9a9e6d60-1b0a-4a18-90bc-b9031cadcfd5 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:33.373154 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a9e6d60-1b0a-4a18-90bc-b9031cadcfd5 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:33.373617 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a9e6d60-1b0a-4a18-90bc-b9031cadcfd5 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:33.374399 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a9e6d60-1b0a-4a18-90bc-b9031cadcfd5 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:33.374831 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9a9e6d60-1b0a-4a18-90bc-b9031cadcfd5 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:33.450368 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-9a9e6d60-1b0a-4a18-90bc-b9031cadcfd5 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:33.458796 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9a9e6d60-1b0a-4a18-90bc-b9031cadcfd5 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1276 microversion: 2.1 time: 0.096709 Oct 28 08:53:33.459363 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 705/1464] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:33 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:34.480240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-74291469-cec1-47b1-a4e0-98b4614b3221 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:34.480879 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-74291469-cec1-47b1-a4e0-98b4614b3221 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:34.488079 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74291469-cec1-47b1-a4e0-98b4614b3221 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:34.488533 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74291469-cec1-47b1-a4e0-98b4614b3221 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:34.489316 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74291469-cec1-47b1-a4e0-98b4614b3221 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:34.489771 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-74291469-cec1-47b1-a4e0-98b4614b3221 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:34.554001 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-b518539d-99a2-4f47-9fb2-5e7f69a26ab4 req-3cdca2fa-6583-4349-9d7e-85025b0dc9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d2e5b11-789c-403e-a726-3c7f0412bc44", "tag": "6e84e39e-941c-43f6-9052-8a92be7b65cb"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:34.559446 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:34.559446 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:53:34.569739 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-b518539d-99a2-4f47-9fb2-5e7f69a26ab4 req-3cdca2fa-6583-4349-9d7e-85025b0dc9d4 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:34.570391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-b518539d-99a2-4f47-9fb2-5e7f69a26ab4 req-3cdca2fa-6583-4349-9d7e-85025b0dc9d4 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:34.583360 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-b518539d-99a2-4f47-9fb2-5e7f69a26ab4 req-3cdca2fa-6583-4349-9d7e-85025b0dc9d4 service nova] Creating event network-changed:6e84e39e-941c-43f6-9052-8a92be7b65cb for instance 1d2e5b11-789c-403e-a726-3c7f0412bc44 on hv-cinder-81566 Oct 28 08:53:34.588605 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-b518539d-99a2-4f47-9fb2-5e7f69a26ab4 req-3cdca2fa-6583-4349-9d7e-85025b0dc9d4 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039996 Oct 28 08:53:34.589443 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 706/1465] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:53:34.745565 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-74291469-cec1-47b1-a4e0-98b4614b3221 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:34.753916 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-74291469-cec1-47b1-a4e0-98b4614b3221 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1318 microversion: 2.1 time: 0.276473 Oct 28 08:53:34.754660 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 760/1466] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:34 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:35.771862 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3b7b25f9-9592-41e8-a495-d06fbd59ae52 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:35.772555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3b7b25f9-9592-41e8-a495-d06fbd59ae52 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:35.778713 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3b7b25f9-9592-41e8-a495-d06fbd59ae52 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:35.779154 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3b7b25f9-9592-41e8-a495-d06fbd59ae52 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:35.779915 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3b7b25f9-9592-41e8-a495-d06fbd59ae52 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:35.780347 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3b7b25f9-9592-41e8-a495-d06fbd59ae52 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:35.905140 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3b7b25f9-9592-41e8-a495-d06fbd59ae52 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:35.912539 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3b7b25f9-9592-41e8-a495-d06fbd59ae52 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1318 microversion: 2.1 time: 0.145459 Oct 28 08:53:35.913107 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 707/1467] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:35 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:36.930390 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d6a08220-d90a-4649-b6aa-9c2f7b37fff7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:36.931223 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d6a08220-d90a-4649-b6aa-9c2f7b37fff7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:36.937646 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d6a08220-d90a-4649-b6aa-9c2f7b37fff7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:36.938096 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d6a08220-d90a-4649-b6aa-9c2f7b37fff7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:36.938873 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d6a08220-d90a-4649-b6aa-9c2f7b37fff7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:36.939308 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d6a08220-d90a-4649-b6aa-9c2f7b37fff7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:37.062384 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d6a08220-d90a-4649-b6aa-9c2f7b37fff7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:37.069964 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d6a08220-d90a-4649-b6aa-9c2f7b37fff7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1318 microversion: 2.1 time: 0.143334 Oct 28 08:53:37.070542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 761/1468] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:36 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:38.087186 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f83f4e50-d7be-46e6-a98d-211a67369683 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:38.087793 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f83f4e50-d7be-46e6-a98d-211a67369683 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:38.094093 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f83f4e50-d7be-46e6-a98d-211a67369683 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:38.094545 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f83f4e50-d7be-46e6-a98d-211a67369683 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:38.095308 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f83f4e50-d7be-46e6-a98d-211a67369683 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:38.095738 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f83f4e50-d7be-46e6-a98d-211a67369683 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:38.219750 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f83f4e50-d7be-46e6-a98d-211a67369683 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:38.227988 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f83f4e50-d7be-46e6-a98d-211a67369683 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1318 microversion: 2.1 time: 0.144648 Oct 28 08:53:38.228577 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 708/1469] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:38 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:39.245858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0cc668e3-bf7a-4a4a-8da4-bb398492d855 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:39.246416 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0cc668e3-bf7a-4a4a-8da4-bb398492d855 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:39.252600 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0cc668e3-bf7a-4a4a-8da4-bb398492d855 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:39.253489 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0cc668e3-bf7a-4a4a-8da4-bb398492d855 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:39.254312 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0cc668e3-bf7a-4a4a-8da4-bb398492d855 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:39.254768 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0cc668e3-bf7a-4a4a-8da4-bb398492d855 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:39.381358 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0cc668e3-bf7a-4a4a-8da4-bb398492d855 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:39.388746 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0cc668e3-bf7a-4a4a-8da4-bb398492d855 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1318 microversion: 2.1 time: 0.147062 Oct 28 08:53:39.389320 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 762/1470] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:39 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:40.405282 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c022d522-3d5f-4f26-ae0d-ed57620a03fa tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:40.405927 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c022d522-3d5f-4f26-ae0d-ed57620a03fa tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:40.412242 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c022d522-3d5f-4f26-ae0d-ed57620a03fa tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:40.412684 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c022d522-3d5f-4f26-ae0d-ed57620a03fa tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:40.413445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c022d522-3d5f-4f26-ae0d-ed57620a03fa tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:40.413909 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c022d522-3d5f-4f26-ae0d-ed57620a03fa tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:40.543331 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-c022d522-3d5f-4f26-ae0d-ed57620a03fa tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:40.550897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c022d522-3d5f-4f26-ae0d-ed57620a03fa tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1318 microversion: 2.1 time: 0.149311 Oct 28 08:53:40.551702 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 709/1471] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:40 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:41.160295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-e7c2b127-9bf4-498b-b99a-6ce40bbbd786 req-17392f06-9884-44d1-9a9c-23a001744d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d2e5b11-789c-403e-a726-3c7f0412bc44", "name": "network-vif-plugged", "status": "completed", "tag": "6e84e39e-941c-43f6-9052-8a92be7b65cb"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:41.162600 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:41.162600 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:53:41.171530 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-e7c2b127-9bf4-498b-b99a-6ce40bbbd786 req-17392f06-9884-44d1-9a9c-23a001744d4c service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:41.172261 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-e7c2b127-9bf4-498b-b99a-6ce40bbbd786 req-17392f06-9884-44d1-9a9c-23a001744d4c service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:41.184316 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-e7c2b127-9bf4-498b-b99a-6ce40bbbd786 req-17392f06-9884-44d1-9a9c-23a001744d4c service nova] Creating event network-vif-plugged:6e84e39e-941c-43f6-9052-8a92be7b65cb for instance 1d2e5b11-789c-403e-a726-3c7f0412bc44 on hv-cinder-81566 Oct 28 08:53:41.189376 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-e7c2b127-9bf4-498b-b99a-6ce40bbbd786 req-17392f06-9884-44d1-9a9c-23a001744d4c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033781 Oct 28 08:53:41.190426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 763/1472] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:53:41.571379 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-f780bfbf-6b10-4962-a6f9-e8cd65c1d3c4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:41.572036 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-f780bfbf-6b10-4962-a6f9-e8cd65c1d3c4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:41.578238 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f780bfbf-6b10-4962-a6f9-e8cd65c1d3c4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:41.578688 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f780bfbf-6b10-4962-a6f9-e8cd65c1d3c4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:41.579475 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f780bfbf-6b10-4962-a6f9-e8cd65c1d3c4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:41.579916 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-f780bfbf-6b10-4962-a6f9-e8cd65c1d3c4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:41.738490 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-f780bfbf-6b10-4962-a6f9-e8cd65c1d3c4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:41.745744 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-f780bfbf-6b10-4962-a6f9-e8cd65c1d3c4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1318 microversion: 2.1 time: 0.181016 Oct 28 08:53:41.746338 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 710/1473] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:41 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:42.763939 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-71386fab-9a47-4833-9c58-5f3ef9253c6f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:42.764876 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-71386fab-9a47-4833-9c58-5f3ef9253c6f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:42.775227 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-71386fab-9a47-4833-9c58-5f3ef9253c6f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:42.775674 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-71386fab-9a47-4833-9c58-5f3ef9253c6f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:42.776465 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-71386fab-9a47-4833-9c58-5f3ef9253c6f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:42.776896 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-71386fab-9a47-4833-9c58-5f3ef9253c6f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:42.910389 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-71386fab-9a47-4833-9c58-5f3ef9253c6f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:42.917922 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-71386fab-9a47-4833-9c58-5f3ef9253c6f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1318 microversion: 2.1 time: 0.158003 Oct 28 08:53:42.918502 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 764/1474] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:42 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:43.935401 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4a47e291-55e6-43ad-890f-74ef02e60de8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:43.936065 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4a47e291-55e6-43ad-890f-74ef02e60de8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:43.942937 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a47e291-55e6-43ad-890f-74ef02e60de8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:43.943378 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a47e291-55e6-43ad-890f-74ef02e60de8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:43.944316 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a47e291-55e6-43ad-890f-74ef02e60de8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:43.944744 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4a47e291-55e6-43ad-890f-74ef02e60de8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:44.066877 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4a47e291-55e6-43ad-890f-74ef02e60de8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:44.074389 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4a47e291-55e6-43ad-890f-74ef02e60de8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1509 microversion: 2.1 time: 0.142702 Oct 28 08:53:44.074983 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 711/1475] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:43 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1509 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:45.438570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b0952827-8bc4-40a9-ae70-adb5ca967b72 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7377c530-72a8-4c81-9182-f5ad0fff540e"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:45.439666 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b0952827-8bc4-40a9-ae70-adb5ca967b72 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:45.446887 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b0952827-8bc4-40a9-ae70-adb5ca967b72 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:45.447329 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b0952827-8bc4-40a9-ae70-adb5ca967b72 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:45.448098 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b0952827-8bc4-40a9-ae70-adb5ca967b72 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:45.448527 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b0952827-8bc4-40a9-ae70-adb5ca967b72 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:45.698941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b0952827-8bc4-40a9-ae70-adb5ca967b72 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "POST /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264048 Oct 28 08:53:45.701155 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 765/1476] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:53:45 2021] POST /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:53:51.859377 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-a4b9e806-7ca9-41f4-85cc-c00706940686 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:51.859859 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a4b9e806-7ca9-41f4-85cc-c00706940686 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:51.863875 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-e88ab372-5ae0-4ee9-9566-544fe620bd30 req-65ef8c82-ad98-45cf-9743-3f4831690426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1", "tag": "0151d785-b8a4-4437-9aa9-d788de11dd43"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:51.865446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:51.865446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:53:51.866354 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4b9e806-7ca9-41f4-85cc-c00706940686 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:51.867016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4b9e806-7ca9-41f4-85cc-c00706940686 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:51.867808 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4b9e806-7ca9-41f4-85cc-c00706940686 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:51.868404 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-a4b9e806-7ca9-41f4-85cc-c00706940686 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:51.873314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-e88ab372-5ae0-4ee9-9566-544fe620bd30 req-65ef8c82-ad98-45cf-9743-3f4831690426 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:51.873998 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-e88ab372-5ae0-4ee9-9566-544fe620bd30 req-65ef8c82-ad98-45cf-9743-3f4831690426 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:51.886582 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-e88ab372-5ae0-4ee9-9566-544fe620bd30 req-65ef8c82-ad98-45cf-9743-3f4831690426 service nova] Creating event network-changed:0151d785-b8a4-4437-9aa9-d788de11dd43 for instance d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 on hv-cinder-81566 Oct 28 08:53:51.892688 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-e88ab372-5ae0-4ee9-9566-544fe620bd30 req-65ef8c82-ad98-45cf-9743-3f4831690426 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033756 Oct 28 08:53:51.893387 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 766/1477] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:53:51.899086 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-a4b9e806-7ca9-41f4-85cc-c00706940686 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:53:51.988958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-a4b9e806-7ca9-41f4-85cc-c00706940686 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "DELETE /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 204 len: 0 microversion: 2.1 time: 0.133234 Oct 28 08:53:51.990339 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 712/1478] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:53:51 2021] DELETE /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:53:52.001385 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b86faf07-d93e-436e-9aa8-a4ff53485b48 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:52.002798 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b86faf07-d93e-436e-9aa8-a4ff53485b48 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:52.010792 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b86faf07-d93e-436e-9aa8-a4ff53485b48 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:52.011232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b86faf07-d93e-436e-9aa8-a4ff53485b48 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:52.012148 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b86faf07-d93e-436e-9aa8-a4ff53485b48 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:52.012574 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b86faf07-d93e-436e-9aa8-a4ff53485b48 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:52.290272 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b86faf07-d93e-436e-9aa8-a4ff53485b48 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:52.298166 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b86faf07-d93e-436e-9aa8-a4ff53485b48 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1569 microversion: 2.1 time: 0.302216 Oct 28 08:53:52.312331 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 767/1479] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:51 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1569 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:53.244537 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-749285134", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "networks": [{"uuid": "4ef62a40-86ce-4d50-abaa-404f56129ded"}]}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:53.296686 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] validate_networks() for [('4ef62a40-86ce-4d50-abaa-404f56129ded', None, None, None, None, None)] {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:53:53.319169 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-747f78c6-55f2-4758-9804-80591c8f8335 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:53.319792 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-747f78c6-55f2-4758-9804-80591c8f8335 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:53.326359 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-747f78c6-55f2-4758-9804-80591c8f8335 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:53.326807 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-747f78c6-55f2-4758-9804-80591c8f8335 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:53.327580 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-747f78c6-55f2-4758-9804-80591c8f8335 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:53.328043 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-747f78c6-55f2-4758-9804-80591c8f8335 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:53.512699 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-747f78c6-55f2-4758-9804-80591c8f8335 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:53.521061 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-747f78c6-55f2-4758-9804-80591c8f8335 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1450 microversion: 2.1 time: 0.205561 Oct 28 08:53:53.521730 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 768/1480] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:53 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1450 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:53.760147 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:53:53.760555 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:53:53.761022 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:53:53.761496 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:53:53.761842 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:53:53.771919 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:53.772351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:53.773257 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:53.773597 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:53.790263 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Getting quotas for project 272e5ae4aa8045a38003e59b113e7898. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:53:53.794434 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Getting quotas for user d8ff8a38c0bd4f559355a124f8a0588c and project 272e5ae4aa8045a38003e59b113e7898. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:53:53.806105 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:53:53.808499 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:53:53.855054 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1be587e3-a953-4a65-b032-cfc2ddaca4a7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614516 Oct 28 08:53:53.855707 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 713/1481] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:53:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:53:53.866364 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-e758d76c-a1bc-4172-811b-1d19ca389f48 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:53.867076 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-e758d76c-a1bc-4172-811b-1d19ca389f48 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:53.927040 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-e758d76c-a1bc-4172-811b-1d19ca389f48 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:53.934243 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-e758d76c-a1bc-4172-811b-1d19ca389f48 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1217 microversion: 2.1 time: 0.071599 Oct 28 08:53:53.934837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 769/1482] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:53 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:54.499756 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-e4e2c331-2f01-448b-99d4-670ba714e94a req-65697442-89f3-4128-baf1-15035867c040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1", "name": "network-vif-deleted", "tag": "0151d785-b8a4-4437-9aa9-d788de11dd43"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:54.502904 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:54.502904 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:53:54.511314 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-e4e2c331-2f01-448b-99d4-670ba714e94a req-65697442-89f3-4128-baf1-15035867c040 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:54.511966 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-e4e2c331-2f01-448b-99d4-670ba714e94a req-65697442-89f3-4128-baf1-15035867c040 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:54.523972 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-e4e2c331-2f01-448b-99d4-670ba714e94a req-65697442-89f3-4128-baf1-15035867c040 service nova] Creating event network-vif-deleted:0151d785-b8a4-4437-9aa9-d788de11dd43 for instance d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 on hv-cinder-81566 Oct 28 08:53:54.528963 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-e4e2c331-2f01-448b-99d4-670ba714e94a req-65697442-89f3-4128-baf1-15035867c040 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034064 Oct 28 08:53:54.529630 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 714/1483] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:53:54.537101 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-48a831aa-05a8-47a5-b58c-ba14c89b5c75 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:54.537706 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-48a831aa-05a8-47a5-b58c-ba14c89b5c75 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:54.544447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48a831aa-05a8-47a5-b58c-ba14c89b5c75 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:54.544886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48a831aa-05a8-47a5-b58c-ba14c89b5c75 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:54.545650 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48a831aa-05a8-47a5-b58c-ba14c89b5c75 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:54.546100 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-48a831aa-05a8-47a5-b58c-ba14c89b5c75 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:54.623821 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-48a831aa-05a8-47a5-b58c-ba14c89b5c75 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4327173547b5425a9e4823c883298ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66afaa2b9f04ea1a518ab92aab8cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:54.632321 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-48a831aa-05a8-47a5-b58c-ba14c89b5c75 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 200 len: 1220 microversion: 2.1 time: 0.098832 Oct 28 08:53:54.632883 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 770/1484] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:54 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:54.951998 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-3ef0a097-3087-4757-a87a-a77e37e1986b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:54.952873 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-3ef0a097-3087-4757-a87a-a77e37e1986b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:54.959676 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3ef0a097-3087-4757-a87a-a77e37e1986b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:54.960489 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3ef0a097-3087-4757-a87a-a77e37e1986b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:54.961476 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3ef0a097-3087-4757-a87a-a77e37e1986b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:54.962177 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-3ef0a097-3087-4757-a87a-a77e37e1986b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:55.033024 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-3ef0a097-3087-4757-a87a-a77e37e1986b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:55.042157 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-3ef0a097-3087-4757-a87a-a77e37e1986b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1287 microversion: 2.1 time: 0.094236 Oct 28 08:53:55.042950 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 715/1485] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:54 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:55.650589 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-802330a4-ce9b-4153-9cb5-2d92bf411324 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:55.652099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-802330a4-ce9b-4153-9cb5-2d92bf411324 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] [instance: d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:55.658733 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-802330a4-ce9b-4153-9cb5-2d92bf411324 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:55.659257 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-802330a4-ce9b-4153-9cb5-2d92bf411324 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:55.660028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-802330a4-ce9b-4153-9cb5-2d92bf411324 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:55.660452 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-802330a4-ce9b-4153-9cb5-2d92bf411324 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:55.675506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-802330a4-ce9b-4153-9cb5-2d92bf411324 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] HTTP exception thrown: Instance d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 could not be found. Oct 28 08:53:55.676099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-802330a4-ce9b-4153-9cb5-2d92bf411324 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Returning 404 to user: Instance d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:53:55.676933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-802330a4-ce9b-4153-9cb5-2d92bf411324 tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1" status: 404 len: 111 microversion: 2.1 time: 0.031318 Oct 28 08:53:55.677493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 771/1486] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:55 2021] GET /compute/v2.1/servers/d87db7e9-b8be-4b2f-bc1d-8bda5bf03ad1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:53:55.981984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-237629d1-5f50-4de7-b900-91d2c6ce515f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] Calling method '.version_select at 0x7f9e78aae430>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:56.011500 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-237629d1-5f50-4de7-b900-91d2c6ce515f tempest-TestShelveInstance-330905447 tempest-TestShelveInstance-330905447-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2050932582" status: 202 len: 0 microversion: 2.1 time: 0.031506 Oct 28 08:53:56.012150 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 716/1487] 10.222.0.74 () {58 vars in 1253 bytes} [Thu Oct 28 08:53:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2050932582 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:53:56.060093 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3244d9e3-40a1-4b05-8e54-4409943af769 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:56.060742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3244d9e3-40a1-4b05-8e54-4409943af769 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:56.067872 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3244d9e3-40a1-4b05-8e54-4409943af769 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:56.068324 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3244d9e3-40a1-4b05-8e54-4409943af769 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:56.069361 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3244d9e3-40a1-4b05-8e54-4409943af769 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:56.069941 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3244d9e3-40a1-4b05-8e54-4409943af769 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:56.261479 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-3244d9e3-40a1-4b05-8e54-4409943af769 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:56.277868 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3244d9e3-40a1-4b05-8e54-4409943af769 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1317 microversion: 2.1 time: 0.221738 Oct 28 08:53:56.280234 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 772/1488] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:56 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:56.550020 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-f68c818b-e0e0-453d-9e8b-e15bd87f6c4c req-6f9425db-a6d6-4912-8bfc-90bf35eb6a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3169d26-f614-4421-bc29-c09940bbc06f", "tag": "f2d8a5ff-605d-4534-b144-6688523ec819"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:56.552169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:56.552169 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:53:56.561099 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-f68c818b-e0e0-453d-9e8b-e15bd87f6c4c req-6f9425db-a6d6-4912-8bfc-90bf35eb6a69 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:56.561824 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-f68c818b-e0e0-453d-9e8b-e15bd87f6c4c req-6f9425db-a6d6-4912-8bfc-90bf35eb6a69 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:56.575129 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-f68c818b-e0e0-453d-9e8b-e15bd87f6c4c req-6f9425db-a6d6-4912-8bfc-90bf35eb6a69 service nova] Creating event network-changed:f2d8a5ff-605d-4534-b144-6688523ec819 for instance a3169d26-f614-4421-bc29-c09940bbc06f on hv-cinder-81566 Oct 28 08:53:56.582850 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-f68c818b-e0e0-453d-9e8b-e15bd87f6c4c req-6f9425db-a6d6-4912-8bfc-90bf35eb6a69 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037344 Oct 28 08:53:56.584199 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 717/1489] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:53:57.297955 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fef9de7c-f2ed-4db8-b2fc-5b80e3c4d709 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:57.298837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fef9de7c-f2ed-4db8-b2fc-5b80e3c4d709 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:57.305352 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fef9de7c-f2ed-4db8-b2fc-5b80e3c4d709 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:57.305830 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fef9de7c-f2ed-4db8-b2fc-5b80e3c4d709 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:57.306640 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fef9de7c-f2ed-4db8-b2fc-5b80e3c4d709 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:57.307069 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fef9de7c-f2ed-4db8-b2fc-5b80e3c4d709 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:57.799667 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-fef9de7c-f2ed-4db8-b2fc-5b80e3c4d709 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:57.807035 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fef9de7c-f2ed-4db8-b2fc-5b80e3c4d709 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1317 microversion: 2.1 time: 0.512890 Oct 28 08:53:57.807998 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 773/1490] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:57 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:58.825526 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-47b0a4c1-f101-4682-aa1c-32b0e3a1b47c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:58.826478 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-47b0a4c1-f101-4682-aa1c-32b0e3a1b47c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:58.833395 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-47b0a4c1-f101-4682-aa1c-32b0e3a1b47c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:58.833864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-47b0a4c1-f101-4682-aa1c-32b0e3a1b47c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:58.834641 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-47b0a4c1-f101-4682-aa1c-32b0e3a1b47c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:58.835073 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-47b0a4c1-f101-4682-aa1c-32b0e3a1b47c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:58.974199 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-47b0a4c1-f101-4682-aa1c-32b0e3a1b47c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:58.982969 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-47b0a4c1-f101-4682-aa1c-32b0e3a1b47c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1317 microversion: 2.1 time: 0.161920 Oct 28 08:53:58.983685 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 718/1491] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:58 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:00.000206 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-99d6bddc-0069-4e7f-b335-94da592feed6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:00.000822 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-99d6bddc-0069-4e7f-b335-94da592feed6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:00.007388 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99d6bddc-0069-4e7f-b335-94da592feed6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:00.007867 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99d6bddc-0069-4e7f-b335-94da592feed6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:00.008652 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99d6bddc-0069-4e7f-b335-94da592feed6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:00.009093 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-99d6bddc-0069-4e7f-b335-94da592feed6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:00.200160 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-99d6bddc-0069-4e7f-b335-94da592feed6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:00.209133 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-99d6bddc-0069-4e7f-b335-94da592feed6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1317 microversion: 2.1 time: 0.212548 Oct 28 08:54:00.209706 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 774/1492] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:59 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:01.226930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ec5078a6-2604-4c13-90ff-45457200bbff tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:01.228208 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ec5078a6-2604-4c13-90ff-45457200bbff tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:01.236961 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ec5078a6-2604-4c13-90ff-45457200bbff tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:01.237800 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ec5078a6-2604-4c13-90ff-45457200bbff tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:01.238805 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ec5078a6-2604-4c13-90ff-45457200bbff tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:01.239818 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ec5078a6-2604-4c13-90ff-45457200bbff tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:01.445298 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ec5078a6-2604-4c13-90ff-45457200bbff tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:01.453594 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ec5078a6-2604-4c13-90ff-45457200bbff tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1317 microversion: 2.1 time: 0.229761 Oct 28 08:54:01.464271 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 719/1493] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:01 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:54:02.472786 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-669c043a-3a26-480c-aeaf-bf6a2b340227 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:02.474147 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-669c043a-3a26-480c-aeaf-bf6a2b340227 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:02.481167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-669c043a-3a26-480c-aeaf-bf6a2b340227 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:02.481691 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-669c043a-3a26-480c-aeaf-bf6a2b340227 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:02.482810 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-669c043a-3a26-480c-aeaf-bf6a2b340227 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:02.483290 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-669c043a-3a26-480c-aeaf-bf6a2b340227 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:02.698392 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-669c043a-3a26-480c-aeaf-bf6a2b340227 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:02.710545 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-669c043a-3a26-480c-aeaf-bf6a2b340227 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1317 microversion: 2.1 time: 0.242168 Oct 28 08:54:02.711166 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 775/1494] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:02 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:03.369026 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-954efbc2-eb92-4fac-a72d-2345a06d84c1 req-feddbae2-ddab-4e82-88c8-b03c6e5a00c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3169d26-f614-4421-bc29-c09940bbc06f", "name": "network-vif-plugged", "status": "completed", "tag": "f2d8a5ff-605d-4534-b144-6688523ec819"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:03.370692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:54:03.370692 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:54:03.380084 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-954efbc2-eb92-4fac-a72d-2345a06d84c1 req-feddbae2-ddab-4e82-88c8-b03c6e5a00c2 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:03.381663 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-954efbc2-eb92-4fac-a72d-2345a06d84c1 req-feddbae2-ddab-4e82-88c8-b03c6e5a00c2 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:03.394280 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-954efbc2-eb92-4fac-a72d-2345a06d84c1 req-feddbae2-ddab-4e82-88c8-b03c6e5a00c2 service nova] Creating event network-vif-plugged:f2d8a5ff-605d-4534-b144-6688523ec819 for instance a3169d26-f614-4421-bc29-c09940bbc06f on hv-cinder-81566 Oct 28 08:54:03.403936 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-954efbc2-eb92-4fac-a72d-2345a06d84c1 req-feddbae2-ddab-4e82-88c8-b03c6e5a00c2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038311 Oct 28 08:54:03.405303 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 720/1495] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:54:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:03.726932 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-46d65e2d-1a86-463f-806f-5256ea76d1d2 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:03.728183 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-46d65e2d-1a86-463f-806f-5256ea76d1d2 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:03.734670 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-46d65e2d-1a86-463f-806f-5256ea76d1d2 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:03.735113 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-46d65e2d-1a86-463f-806f-5256ea76d1d2 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:03.735946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-46d65e2d-1a86-463f-806f-5256ea76d1d2 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:03.737099 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-46d65e2d-1a86-463f-806f-5256ea76d1d2 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:03.877933 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-46d65e2d-1a86-463f-806f-5256ea76d1d2 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:03.886408 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-46d65e2d-1a86-463f-806f-5256ea76d1d2 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1317 microversion: 2.1 time: 0.163089 Oct 28 08:54:03.886993 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 776/1496] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:03 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:04.904155 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1e14f596-e18f-4337-971a-4bb48b544f85 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:04.904849 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1e14f596-e18f-4337-971a-4bb48b544f85 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:04.910941 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e14f596-e18f-4337-971a-4bb48b544f85 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:04.911391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e14f596-e18f-4337-971a-4bb48b544f85 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:04.912172 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e14f596-e18f-4337-971a-4bb48b544f85 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:04.912611 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e14f596-e18f-4337-971a-4bb48b544f85 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:05.052186 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-1e14f596-e18f-4337-971a-4bb48b544f85 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:05.059351 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1e14f596-e18f-4337-971a-4bb48b544f85 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1317 microversion: 2.1 time: 0.159755 Oct 28 08:54:05.059909 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 721/1497] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:04 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:06.076989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-87f1d4d6-1954-4444-88e3-9a09f32861df tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:06.077620 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-87f1d4d6-1954-4444-88e3-9a09f32861df tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:06.083855 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-87f1d4d6-1954-4444-88e3-9a09f32861df tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:06.084295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-87f1d4d6-1954-4444-88e3-9a09f32861df tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:06.085057 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-87f1d4d6-1954-4444-88e3-9a09f32861df tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:06.085488 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-87f1d4d6-1954-4444-88e3-9a09f32861df tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:06.211849 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-87f1d4d6-1954-4444-88e3-9a09f32861df tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:06.219823 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-87f1d4d6-1954-4444-88e3-9a09f32861df tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1508 microversion: 2.1 time: 0.146413 Oct 28 08:54:06.221086 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 777/1498] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:06 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:06.238076 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c243256a-fee9-4e49-af75-f428876caaf1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7377c530-72a8-4c81-9182-f5ad0fff540e"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:06.239130 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c243256a-fee9-4e49-af75-f428876caaf1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:06.245405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c243256a-fee9-4e49-af75-f428876caaf1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:06.245891 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c243256a-fee9-4e49-af75-f428876caaf1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:06.246665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c243256a-fee9-4e49-af75-f428876caaf1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:06.247136 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c243256a-fee9-4e49-af75-f428876caaf1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:06.330419 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-c243256a-fee9-4e49-af75-f428876caaf1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] HTTP exception thrown: Invalid volume: volume 7377c530-72a8-4c81-9182-f5ad0fff540e is already attached to instances: 1d2e5b11-789c-403e-a726-3c7f0412bc44 Oct 28 08:54:06.330916 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c243256a-fee9-4e49-af75-f428876caaf1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Returning 400 to user: Invalid volume: volume 7377c530-72a8-4c81-9182-f5ad0fff540e is already attached to instances: 1d2e5b11-789c-403e-a726-3c7f0412bc44 {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:54:06.331767 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c243256a-fee9-4e49-af75-f428876caaf1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "POST /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098366 Oct 28 08:54:06.332389 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 722/1499] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:54:06 2021] POST /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:54:06.402944 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-fa529e80-edda-4471-a552-7f3a41384841 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:06.403421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-fa529e80-edda-4471-a552-7f3a41384841 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:06.411695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fa529e80-edda-4471-a552-7f3a41384841 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:06.412147 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fa529e80-edda-4471-a552-7f3a41384841 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:06.412923 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fa529e80-edda-4471-a552-7f3a41384841 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:06.413362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-fa529e80-edda-4471-a552-7f3a41384841 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:06.499489 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-fa529e80-edda-4471-a552-7f3a41384841 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lazy-loading 'services' on Instance uuid 1d2e5b11-789c-403e-a726-3c7f0412bc44 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:54:06.570089 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-fa529e80-edda-4471-a552-7f3a41384841 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44/os-volume_attachments/7377c530-72a8-4c81-9182-f5ad0fff540e" status: 202 len: 0 microversion: 2.1 time: 0.170564 Oct 28 08:54:06.570688 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 778/1500] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:54:06 2021] DELETE /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44/os-volume_attachments/7377c530-72a8-4c81-9182-f5ad0fff540e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:54:06.578924 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-0b549358-cbd4-4fd4-9cd8-1673085756f7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:06.584733 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-0b549358-cbd4-4fd4-9cd8-1673085756f7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:06.598028 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b549358-cbd4-4fd4-9cd8-1673085756f7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:06.598590 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b549358-cbd4-4fd4-9cd8-1673085756f7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:06.599458 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b549358-cbd4-4fd4-9cd8-1673085756f7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:06.599915 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-0b549358-cbd4-4fd4-9cd8-1673085756f7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:06.638872 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-0b549358-cbd4-4fd4-9cd8-1673085756f7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061487 Oct 28 08:54:06.638872 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 723/1501] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:54:06 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:54:07.649544 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-7a690145-2f54-43fb-9011-901bee254a49 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:07.650631 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-7a690145-2f54-43fb-9011-901bee254a49 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:07.656878 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a690145-2f54-43fb-9011-901bee254a49 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:07.657314 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a690145-2f54-43fb-9011-901bee254a49 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:07.658604 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a690145-2f54-43fb-9011-901bee254a49 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:07.659033 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-7a690145-2f54-43fb-9011-901bee254a49 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:07.692198 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-7a690145-2f54-43fb-9011-901bee254a49 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047169 Oct 28 08:54:07.692799 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 779/1502] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:54:07 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:54:07.843062 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-784711500", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "networks": [{"uuid": "4ef62a40-86ce-4d50-abaa-404f56129ded"}]}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:07.894876 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.network.neutron [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] validate_networks() for [('4ef62a40-86ce-4d50-abaa-404f56129ded', None, None, None, None, None)] {{(pid=132796) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:54:08.289615 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Flavor limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:54:08.290068 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Image limits 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:54:08.290529 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Flavor pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:54:08.290927 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Image pref 0:0:0 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:54:08.291325 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.virt.hardware [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:54:08.300854 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:08.301292 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:08.302112 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:08.302535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:08.320896 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Getting quotas for project 272e5ae4aa8045a38003e59b113e7898. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:54:08.324939 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.quota [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Getting quotas for user d8ff8a38c0bd4f559355a124f8a0588c and project 272e5ae4aa8045a38003e59b113e7898. Resources: {'cores', 'instances', 'ram'} {{(pid=132796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:54:08.335658 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Going to run 1 instances... {{(pid=132796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:54:08.337984 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:54:08.391418 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-81c9bd45-5fb8-46e8-81f6-35bca414b814 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552099 Oct 28 08:54:08.392188 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 724/1503] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:54:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:54:08.402558 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-4adaa231-7a9c-4988-908c-86e493e80ad4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:08.403331 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-4adaa231-7a9c-4988-908c-86e493e80ad4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:08.458748 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-4adaa231-7a9c-4988-908c-86e493e80ad4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:08.465997 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-4adaa231-7a9c-4988-908c-86e493e80ad4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1217 microversion: 2.1 time: 0.067265 Oct 28 08:54:08.466813 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 780/1504] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:08 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:09.484320 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-cbfc12a4-ea69-4abd-aeb8-714f21ff648a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:09.485191 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-cbfc12a4-ea69-4abd-aeb8-714f21ff648a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:09.492018 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cbfc12a4-ea69-4abd-aeb8-714f21ff648a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:09.492478 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cbfc12a4-ea69-4abd-aeb8-714f21ff648a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:09.493238 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cbfc12a4-ea69-4abd-aeb8-714f21ff648a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:09.493667 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-cbfc12a4-ea69-4abd-aeb8-714f21ff648a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:09.714419 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-cbfc12a4-ea69-4abd-aeb8-714f21ff648a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:09.723795 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-cbfc12a4-ea69-4abd-aeb8-714f21ff648a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1275 microversion: 2.1 time: 0.243728 Oct 28 08:54:09.724595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 725/1505] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:09 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:10.741918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-cac327b5-0cdf-4dc7-bfe3-fe30ec8042d9 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:10.742674 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-cac327b5-0cdf-4dc7-bfe3-fe30ec8042d9 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:10.749089 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cac327b5-0cdf-4dc7-bfe3-fe30ec8042d9 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:10.749538 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cac327b5-0cdf-4dc7-bfe3-fe30ec8042d9 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:10.750510 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cac327b5-0cdf-4dc7-bfe3-fe30ec8042d9 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:10.750937 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-cac327b5-0cdf-4dc7-bfe3-fe30ec8042d9 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:10.973749 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-cac327b5-0cdf-4dc7-bfe3-fe30ec8042d9 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:10.981541 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-cac327b5-0cdf-4dc7-bfe3-fe30ec8042d9 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1317 microversion: 2.1 time: 0.243219 Oct 28 08:54:10.982167 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 781/1506] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:10 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:11.093137 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-be4af68d-1cd6-487f-b6b1-36e32c943c4a req-c52efd29-ae52-4581-94f3-e75c4423d7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7", "tag": "6a3666ca-6772-446f-93c4-06112a50eafa"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:11.095865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:54:11.095865 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:54:11.104996 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-be4af68d-1cd6-487f-b6b1-36e32c943c4a req-c52efd29-ae52-4581-94f3-e75c4423d7a8 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:11.105930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-be4af68d-1cd6-487f-b6b1-36e32c943c4a req-c52efd29-ae52-4581-94f3-e75c4423d7a8 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:11.120502 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-be4af68d-1cd6-487f-b6b1-36e32c943c4a req-c52efd29-ae52-4581-94f3-e75c4423d7a8 service nova] Creating event network-changed:6a3666ca-6772-446f-93c4-06112a50eafa for instance 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 on hv-cinder-81566 Oct 28 08:54:11.125518 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-be4af68d-1cd6-487f-b6b1-36e32c943c4a req-c52efd29-ae52-4581-94f3-e75c4423d7a8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036519 Oct 28 08:54:11.126700 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 726/1507] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:54:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:54:11.999243 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-75d2900b-55b8-4c06-9742-7d6295f8ae94 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:11.999839 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-75d2900b-55b8-4c06-9742-7d6295f8ae94 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:12.006440 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-75d2900b-55b8-4c06-9742-7d6295f8ae94 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:12.006886 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-75d2900b-55b8-4c06-9742-7d6295f8ae94 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:12.007845 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-75d2900b-55b8-4c06-9742-7d6295f8ae94 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:12.008258 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-75d2900b-55b8-4c06-9742-7d6295f8ae94 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:12.151175 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-75d2900b-55b8-4c06-9742-7d6295f8ae94 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:12.159169 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-75d2900b-55b8-4c06-9742-7d6295f8ae94 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1317 microversion: 2.1 time: 0.163888 Oct 28 08:54:12.159738 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 782/1508] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:11 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:54:13.177602 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-53395dc0-a469-40d4-949c-1f95152f0c50 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:13.178325 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-53395dc0-a469-40d4-949c-1f95152f0c50 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:13.184463 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-53395dc0-a469-40d4-949c-1f95152f0c50 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:13.184910 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-53395dc0-a469-40d4-949c-1f95152f0c50 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:13.185674 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-53395dc0-a469-40d4-949c-1f95152f0c50 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:13.186136 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-53395dc0-a469-40d4-949c-1f95152f0c50 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:13.322846 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-53395dc0-a469-40d4-949c-1f95152f0c50 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:13.330828 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-53395dc0-a469-40d4-949c-1f95152f0c50 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1317 microversion: 2.1 time: 0.158162 Oct 28 08:54:13.331423 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 727/1509] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:13 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:14.349999 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-95d87e22-1797-4928-b9cd-fdff32a052e6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:14.350655 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-95d87e22-1797-4928-b9cd-fdff32a052e6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:14.357322 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95d87e22-1797-4928-b9cd-fdff32a052e6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:14.357766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95d87e22-1797-4928-b9cd-fdff32a052e6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:14.358596 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95d87e22-1797-4928-b9cd-fdff32a052e6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:14.359028 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-95d87e22-1797-4928-b9cd-fdff32a052e6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:14.507026 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-95d87e22-1797-4928-b9cd-fdff32a052e6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:14.518555 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-95d87e22-1797-4928-b9cd-fdff32a052e6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1317 microversion: 2.1 time: 0.174631 Oct 28 08:54:14.519078 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 783/1510] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:14 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:15.535696 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-ee4b364f-6d9e-4b5a-a0a4-a58855aa1583 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:15.536320 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-ee4b364f-6d9e-4b5a-a0a4-a58855aa1583 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:15.542803 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ee4b364f-6d9e-4b5a-a0a4-a58855aa1583 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:15.543239 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ee4b364f-6d9e-4b5a-a0a4-a58855aa1583 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:15.543988 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ee4b364f-6d9e-4b5a-a0a4-a58855aa1583 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:15.544408 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-ee4b364f-6d9e-4b5a-a0a4-a58855aa1583 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:15.673130 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-ee4b364f-6d9e-4b5a-a0a4-a58855aa1583 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:15.680823 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-ee4b364f-6d9e-4b5a-a0a4-a58855aa1583 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1317 microversion: 2.1 time: 0.149448 Oct 28 08:54:15.681406 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 728/1511] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:15 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:16.698419 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-d3d7b58c-656f-47f6-85c8-dd77ff38e929 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:16.699021 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-d3d7b58c-656f-47f6-85c8-dd77ff38e929 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:16.705921 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d3d7b58c-656f-47f6-85c8-dd77ff38e929 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:16.706364 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d3d7b58c-656f-47f6-85c8-dd77ff38e929 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:16.707146 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d3d7b58c-656f-47f6-85c8-dd77ff38e929 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:16.707596 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-d3d7b58c-656f-47f6-85c8-dd77ff38e929 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:16.847657 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-d3d7b58c-656f-47f6-85c8-dd77ff38e929 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:16.857187 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-d3d7b58c-656f-47f6-85c8-dd77ff38e929 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1317 microversion: 2.1 time: 0.162303 Oct 28 08:54:16.858387 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 784/1512] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:16 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:17.412078 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-b9bd91bd-4bfc-46da-9307-0e262f81c854 req-01e7b8bc-01b7-4848-9b48-017a83dd6ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7", "name": "network-vif-plugged", "status": "completed", "tag": "6a3666ca-6772-446f-93c4-06112a50eafa"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:17.413662 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:54:17.413662 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:54:17.421303 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-b9bd91bd-4bfc-46da-9307-0e262f81c854 req-01e7b8bc-01b7-4848-9b48-017a83dd6ecf service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:17.421748 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-b9bd91bd-4bfc-46da-9307-0e262f81c854 req-01e7b8bc-01b7-4848-9b48-017a83dd6ecf service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:17.435040 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-b9bd91bd-4bfc-46da-9307-0e262f81c854 req-01e7b8bc-01b7-4848-9b48-017a83dd6ecf service nova] Creating event network-vif-plugged:6a3666ca-6772-446f-93c4-06112a50eafa for instance 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 on hv-cinder-81566 Oct 28 08:54:17.440289 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-b9bd91bd-4bfc-46da-9307-0e262f81c854 req-01e7b8bc-01b7-4848-9b48-017a83dd6ecf service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031883 Oct 28 08:54:17.441089 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 729/1513] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:54:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:17.875459 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-0a944927-6fb7-41d6-b439-303d1c724329 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:17.876506 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-0a944927-6fb7-41d6-b439-303d1c724329 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:17.882766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0a944927-6fb7-41d6-b439-303d1c724329 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:17.883216 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0a944927-6fb7-41d6-b439-303d1c724329 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:17.883981 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0a944927-6fb7-41d6-b439-303d1c724329 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:17.884409 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-0a944927-6fb7-41d6-b439-303d1c724329 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:18.012215 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-0a944927-6fb7-41d6-b439-303d1c724329 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:18.020231 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-0a944927-6fb7-41d6-b439-303d1c724329 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1317 microversion: 2.1 time: 0.148553 Oct 28 08:54:18.020809 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 785/1514] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:17 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:19.038166 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b56ea553-b265-4a8f-9bf2-7f9947a77e28 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:19.039129 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b56ea553-b265-4a8f-9bf2-7f9947a77e28 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:19.045807 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b56ea553-b265-4a8f-9bf2-7f9947a77e28 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:19.046258 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b56ea553-b265-4a8f-9bf2-7f9947a77e28 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:19.047043 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b56ea553-b265-4a8f-9bf2-7f9947a77e28 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:19.047478 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b56ea553-b265-4a8f-9bf2-7f9947a77e28 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:19.175583 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-b56ea553-b265-4a8f-9bf2-7f9947a77e28 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:19.183019 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b56ea553-b265-4a8f-9bf2-7f9947a77e28 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1317 microversion: 2.1 time: 0.149494 Oct 28 08:54:19.183606 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 730/1515] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:19 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:20.200300 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a27f51ba-6781-463e-ba0e-7f52ac65d8af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:20.200925 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a27f51ba-6781-463e-ba0e-7f52ac65d8af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:20.207853 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a27f51ba-6781-463e-ba0e-7f52ac65d8af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:20.208305 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a27f51ba-6781-463e-ba0e-7f52ac65d8af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:20.209070 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a27f51ba-6781-463e-ba0e-7f52ac65d8af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:20.209505 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a27f51ba-6781-463e-ba0e-7f52ac65d8af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:20.336764 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a27f51ba-6781-463e-ba0e-7f52ac65d8af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:20.348202 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a27f51ba-6781-463e-ba0e-7f52ac65d8af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1508 microversion: 2.1 time: 0.151570 Oct 28 08:54:20.348798 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 786/1516] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:20 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:21.669425 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-9cc9dc9e-8a3b-41c2-b8cc-029154d913c8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "158afa71-3020-4f00-9719-9947d94b7c33"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:21.670606 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-9cc9dc9e-8a3b-41c2-b8cc-029154d913c8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:21.682032 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9cc9dc9e-8a3b-41c2-b8cc-029154d913c8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:21.682483 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9cc9dc9e-8a3b-41c2-b8cc-029154d913c8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:21.683272 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9cc9dc9e-8a3b-41c2-b8cc-029154d913c8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:21.683714 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-9cc9dc9e-8a3b-41c2-b8cc-029154d913c8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:21.937102 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-9cc9dc9e-8a3b-41c2-b8cc-029154d913c8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "POST /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271410 Oct 28 08:54:21.937675 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 731/1517] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:54:21 2021] POST /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:29.440436 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-445e61ea-52f4-473a-9491-f613979b56af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "158afa71-3020-4f00-9719-9947d94b7c33"}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:29.441531 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-445e61ea-52f4-473a-9491-f613979b56af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:29.447721 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-445e61ea-52f4-473a-9491-f613979b56af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:29.448166 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-445e61ea-52f4-473a-9491-f613979b56af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:29.448917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-445e61ea-52f4-473a-9491-f613979b56af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:29.449340 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-445e61ea-52f4-473a-9491-f613979b56af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:29.528747 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-445e61ea-52f4-473a-9491-f613979b56af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] HTTP exception thrown: Invalid volume: volume 158afa71-3020-4f00-9719-9947d94b7c33 is already attached to instances: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 Oct 28 08:54:29.529350 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-445e61ea-52f4-473a-9491-f613979b56af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Returning 400 to user: Invalid volume: volume 158afa71-3020-4f00-9719-9947d94b7c33 is already attached to instances: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:54:29.530225 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-445e61ea-52f4-473a-9491-f613979b56af tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "POST /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094815 Oct 28 08:54:29.530776 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 787/1518] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:54:29 2021] POST /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:54:29.595355 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c6eac16c-99b7-4b2f-92d2-aff39f3e2827 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:29.595948 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c6eac16c-99b7-4b2f-92d2-aff39f3e2827 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:29.601911 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6eac16c-99b7-4b2f-92d2-aff39f3e2827 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:29.602361 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6eac16c-99b7-4b2f-92d2-aff39f3e2827 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:29.603117 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6eac16c-99b7-4b2f-92d2-aff39f3e2827 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:29.603548 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c6eac16c-99b7-4b2f-92d2-aff39f3e2827 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:29.690808 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.objects.instance [None req-c6eac16c-99b7-4b2f-92d2-aff39f3e2827 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lazy-loading 'services' on Instance uuid 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 {{(pid=132796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:54:29.765085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c6eac16c-99b7-4b2f-92d2-aff39f3e2827 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7/os-volume_attachments/158afa71-3020-4f00-9719-9947d94b7c33" status: 202 len: 0 microversion: 2.1 time: 0.174654 Oct 28 08:54:29.765679 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 732/1519] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:54:29 2021] DELETE /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7/os-volume_attachments/158afa71-3020-4f00-9719-9947d94b7c33 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:54:29.774241 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c3f4f7b8-9fc7-41ac-b44a-9ff070612c01 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:29.775168 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c3f4f7b8-9fc7-41ac-b44a-9ff070612c01 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:29.782057 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c3f4f7b8-9fc7-41ac-b44a-9ff070612c01 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:29.782659 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c3f4f7b8-9fc7-41ac-b44a-9ff070612c01 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:29.783426 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c3f4f7b8-9fc7-41ac-b44a-9ff070612c01 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:29.783859 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c3f4f7b8-9fc7-41ac-b44a-9ff070612c01 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:29.820766 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c3f4f7b8-9fc7-41ac-b44a-9ff070612c01 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050310 Oct 28 08:54:29.821350 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 788/1520] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:54:29 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:30.834042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-d7b0dae2-42be-4177-b3f1-8b332f3d163e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:30.835018 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-d7b0dae2-42be-4177-b3f1-8b332f3d163e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:30.841535 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7b0dae2-42be-4177-b3f1-8b332f3d163e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:30.842003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7b0dae2-42be-4177-b3f1-8b332f3d163e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:30.842780 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7b0dae2-42be-4177-b3f1-8b332f3d163e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:30.843206 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-d7b0dae2-42be-4177-b3f1-8b332f3d163e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:30.873490 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-d7b0dae2-42be-4177-b3f1-8b332f3d163e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044603 Oct 28 08:54:30.874077 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 733/1521] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:54:30 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:54:30.973202 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-259949518", "imageRef": "905757ca-f54c-4094-a889-64a31151a3fb", "flavorRef": "452", "networks": [{"uuid": "4ef62a40-86ce-4d50-abaa-404f56129ded"}]}} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:31.024793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.network.neutron [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] validate_networks() for [('4ef62a40-86ce-4d50-abaa-404f56129ded', None, None, None, None, None)] {{(pid=132797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:54:31.516793 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Flavor limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:54:31.517360 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Image limits 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:54:31.518006 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Flavor pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:54:31.518417 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Image pref 0:0:0 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:54:31.518856 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.virt.hardware [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:54:31.527652 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:31.528095 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:31.528902 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:31.529330 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:31.546422 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Getting quotas for project 272e5ae4aa8045a38003e59b113e7898. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:54:31.551730 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.quota [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Getting quotas for user d8ff8a38c0bd4f559355a124f8a0588c and project 272e5ae4aa8045a38003e59b113e7898. Resources: {'cores', 'instances', 'ram'} {{(pid=132797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:54:31.563509 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Going to run 1 instances... {{(pid=132797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:54:31.566011 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='905757ca-f54c-4094-a889-64a31151a3fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:54:31.611060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-306a64f0-0731-46ea-8893-149e12b1d21c tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642309 Oct 28 08:54:31.611714 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 789/1522] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Oct 28 08:54:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:54:31.622157 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-58ca252e-fb72-4d86-87f4-e842a3104626 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:31.622952 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-58ca252e-fb72-4d86-87f4-e842a3104626 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:31.679096 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-58ca252e-fb72-4d86-87f4-e842a3104626 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:31.686126 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-58ca252e-fb72-4d86-87f4-e842a3104626 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1217 microversion: 2.1 time: 0.067668 Oct 28 08:54:31.687322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 734/1523] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:31 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:32.705814 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9d440933-1a8b-4a64-a1e9-4c085adc4113 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:32.706847 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9d440933-1a8b-4a64-a1e9-4c085adc4113 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:32.715610 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9d440933-1a8b-4a64-a1e9-4c085adc4113 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:32.716176 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9d440933-1a8b-4a64-a1e9-4c085adc4113 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:32.717672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9d440933-1a8b-4a64-a1e9-4c085adc4113 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:32.718185 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9d440933-1a8b-4a64-a1e9-4c085adc4113 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:32.786875 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9d440933-1a8b-4a64-a1e9-4c085adc4113 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:32.794334 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9d440933-1a8b-4a64-a1e9-4c085adc4113 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1275 microversion: 2.1 time: 0.093547 Oct 28 08:54:32.794909 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 790/1524] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:32 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:33.813197 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-6fe1fb79-1011-43a5-837a-1fc267a4f721 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:33.814384 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-6fe1fb79-1011-43a5-837a-1fc267a4f721 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:33.822493 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6fe1fb79-1011-43a5-837a-1fc267a4f721 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:33.822944 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6fe1fb79-1011-43a5-837a-1fc267a4f721 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:33.823721 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6fe1fb79-1011-43a5-837a-1fc267a4f721 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:33.824154 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-6fe1fb79-1011-43a5-837a-1fc267a4f721 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:33.998921 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-984b26b5-45b5-4b22-ba0e-076350a7561c req-ce7b99be-1202-4911-a673-6d8c314607cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9c707d-9384-416f-9181-499ac9dc8188", "tag": "7dc3608d-196c-466e-b72c-7b40bbdba7d7"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:34.003515 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:54:34.003515 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:54:34.020276 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-984b26b5-45b5-4b22-ba0e-076350a7561c req-ce7b99be-1202-4911-a673-6d8c314607cf service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:34.020816 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-984b26b5-45b5-4b22-ba0e-076350a7561c req-ce7b99be-1202-4911-a673-6d8c314607cf service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:34.032765 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-984b26b5-45b5-4b22-ba0e-076350a7561c req-ce7b99be-1202-4911-a673-6d8c314607cf service nova] Creating event network-changed:7dc3608d-196c-466e-b72c-7b40bbdba7d7 for instance 0f9c707d-9384-416f-9181-499ac9dc8188 on hv-cinder-81566 Oct 28 08:54:34.043327 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-984b26b5-45b5-4b22-ba0e-076350a7561c req-ce7b99be-1202-4911-a673-6d8c314607cf service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048042 Oct 28 08:54:34.044056 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-6fe1fb79-1011-43a5-837a-1fc267a4f721 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:34.044427 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 791/1525] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:54:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:34.054897 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-6fe1fb79-1011-43a5-837a-1fc267a4f721 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1317 microversion: 2.1 time: 0.246202 Oct 28 08:54:34.055479 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 735/1526] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:33 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:35.073366 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2aa8d237-1118-482d-a7c6-b559c35544f1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:35.074091 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2aa8d237-1118-482d-a7c6-b559c35544f1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:35.080831 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2aa8d237-1118-482d-a7c6-b559c35544f1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:35.081278 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2aa8d237-1118-482d-a7c6-b559c35544f1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:35.082078 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2aa8d237-1118-482d-a7c6-b559c35544f1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:35.082516 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2aa8d237-1118-482d-a7c6-b559c35544f1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:35.214839 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2aa8d237-1118-482d-a7c6-b559c35544f1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:35.222446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2aa8d237-1118-482d-a7c6-b559c35544f1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1317 microversion: 2.1 time: 0.153597 Oct 28 08:54:35.223022 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 792/1527] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:35 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:36.239484 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-5bd088cb-392e-4865-8644-853568b3e9fb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:36.240109 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-5bd088cb-392e-4865-8644-853568b3e9fb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:36.246377 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5bd088cb-392e-4865-8644-853568b3e9fb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:36.246826 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5bd088cb-392e-4865-8644-853568b3e9fb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:36.247593 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5bd088cb-392e-4865-8644-853568b3e9fb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:36.248028 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-5bd088cb-392e-4865-8644-853568b3e9fb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:36.378427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-5bd088cb-392e-4865-8644-853568b3e9fb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:36.386469 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-5bd088cb-392e-4865-8644-853568b3e9fb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1317 microversion: 2.1 time: 0.150642 Oct 28 08:54:36.387016 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 736/1528] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:36 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:37.405006 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5a0f9120-8cf3-4150-b5ac-2b8ae635e45a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:37.406208 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5a0f9120-8cf3-4150-b5ac-2b8ae635e45a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:37.412703 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5a0f9120-8cf3-4150-b5ac-2b8ae635e45a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:37.413140 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5a0f9120-8cf3-4150-b5ac-2b8ae635e45a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:37.414232 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5a0f9120-8cf3-4150-b5ac-2b8ae635e45a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:37.414690 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5a0f9120-8cf3-4150-b5ac-2b8ae635e45a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:37.547077 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-5a0f9120-8cf3-4150-b5ac-2b8ae635e45a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:37.554864 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5a0f9120-8cf3-4150-b5ac-2b8ae635e45a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1317 microversion: 2.1 time: 0.153741 Oct 28 08:54:37.555423 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 793/1529] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:37 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:38.572804 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-e90f7844-f8ee-4475-abd7-5f006c15dc2b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:38.573391 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-e90f7844-f8ee-4475-abd7-5f006c15dc2b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:38.580976 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e90f7844-f8ee-4475-abd7-5f006c15dc2b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:38.581423 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e90f7844-f8ee-4475-abd7-5f006c15dc2b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:38.582241 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e90f7844-f8ee-4475-abd7-5f006c15dc2b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:38.582682 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-e90f7844-f8ee-4475-abd7-5f006c15dc2b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:38.708514 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-e90f7844-f8ee-4475-abd7-5f006c15dc2b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:38.715973 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-e90f7844-f8ee-4475-abd7-5f006c15dc2b tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1317 microversion: 2.1 time: 0.147135 Oct 28 08:54:38.716544 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 737/1530] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:38 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:39.733739 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-6eab7ff3-9737-4032-81fd-e1861fdfcb6a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:39.735035 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-6eab7ff3-9737-4032-81fd-e1861fdfcb6a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:39.741885 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6eab7ff3-9737-4032-81fd-e1861fdfcb6a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:39.742323 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6eab7ff3-9737-4032-81fd-e1861fdfcb6a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:39.743086 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6eab7ff3-9737-4032-81fd-e1861fdfcb6a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:39.743512 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-6eab7ff3-9737-4032-81fd-e1861fdfcb6a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:40.140729 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-6eab7ff3-9737-4032-81fd-e1861fdfcb6a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:40.148050 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-6eab7ff3-9737-4032-81fd-e1861fdfcb6a tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1317 microversion: 2.1 time: 0.417884 Oct 28 08:54:40.148648 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 794/1531] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:39 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:54:41.165322 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-38e7310d-c719-4a35-9201-892815c7b443 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:41.165958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-38e7310d-c719-4a35-9201-892815c7b443 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:41.172665 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38e7310d-c719-4a35-9201-892815c7b443 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:41.173109 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38e7310d-c719-4a35-9201-892815c7b443 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:41.173910 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38e7310d-c719-4a35-9201-892815c7b443 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:41.174345 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-38e7310d-c719-4a35-9201-892815c7b443 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:41.304237 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-38e7310d-c719-4a35-9201-892815c7b443 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:41.311485 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-38e7310d-c719-4a35-9201-892815c7b443 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1317 microversion: 2.1 time: 0.150292 Oct 28 08:54:41.312042 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 738/1532] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:41 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:41.503691 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-8c4d8eda-7e87-448a-a632-dbff517691d1 req-3c23c523-e573-4082-a4b7-b32f65280bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9c707d-9384-416f-9181-499ac9dc8188", "name": "network-vif-plugged", "status": "completed", "tag": "7dc3608d-196c-466e-b72c-7b40bbdba7d7"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:41.505291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:54:41.505291 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:54:41.512823 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-8c4d8eda-7e87-448a-a632-dbff517691d1 req-3c23c523-e573-4082-a4b7-b32f65280bb5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:41.513259 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-8c4d8eda-7e87-448a-a632-dbff517691d1 req-3c23c523-e573-4082-a4b7-b32f65280bb5 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:41.525295 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-8c4d8eda-7e87-448a-a632-dbff517691d1 req-3c23c523-e573-4082-a4b7-b32f65280bb5 service nova] Creating event network-vif-plugged:7dc3608d-196c-466e-b72c-7b40bbdba7d7 for instance 0f9c707d-9384-416f-9181-499ac9dc8188 on hv-cinder-81566 Oct 28 08:54:41.530240 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-8c4d8eda-7e87-448a-a632-dbff517691d1 req-3c23c523-e573-4082-a4b7-b32f65280bb5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030904 Oct 28 08:54:41.530920 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 795/1533] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:54:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:42.329386 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-4f78ffe1-3f92-4821-a8f0-161f24af00a0 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:42.330025 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-4f78ffe1-3f92-4821-a8f0-161f24af00a0 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:42.339920 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4f78ffe1-3f92-4821-a8f0-161f24af00a0 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:42.340609 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4f78ffe1-3f92-4821-a8f0-161f24af00a0 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:42.341421 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4f78ffe1-3f92-4821-a8f0-161f24af00a0 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:42.341881 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-4f78ffe1-3f92-4821-a8f0-161f24af00a0 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:42.468078 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-4f78ffe1-3f92-4821-a8f0-161f24af00a0 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:42.475595 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-4f78ffe1-3f92-4821-a8f0-161f24af00a0 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1317 microversion: 2.1 time: 0.150029 Oct 28 08:54:42.476167 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 739/1534] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:42 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:43.493946 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-eb6ec23c-963f-4aa0-a3f5-daca4d700b9f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:43.494695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-eb6ec23c-963f-4aa0-a3f5-daca4d700b9f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:43.501415 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb6ec23c-963f-4aa0-a3f5-daca4d700b9f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:43.502102 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb6ec23c-963f-4aa0-a3f5-daca4d700b9f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:43.502898 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb6ec23c-963f-4aa0-a3f5-daca4d700b9f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:43.503334 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-eb6ec23c-963f-4aa0-a3f5-daca4d700b9f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:43.627701 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-eb6ec23c-963f-4aa0-a3f5-daca4d700b9f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:43.635493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-eb6ec23c-963f-4aa0-a3f5-daca4d700b9f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1507 microversion: 2.1 time: 0.146037 Oct 28 08:54:43.636210 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 796/1535] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:43 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:44.949962 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-78cce943-bed4-4295-9901-c7e278468f55 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6692642-b0a2-4667-a5fc-adec2b102273"}} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:44.950930 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-78cce943-bed4-4295-9901-c7e278468f55 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:44.957267 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-78cce943-bed4-4295-9901-c7e278468f55 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:44.957763 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-78cce943-bed4-4295-9901-c7e278468f55 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:44.958557 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-78cce943-bed4-4295-9901-c7e278468f55 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:44.958989 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-78cce943-bed4-4295-9901-c7e278468f55 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:45.211127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-78cce943-bed4-4295-9901-c7e278468f55 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "POST /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264821 Oct 28 08:54:45.212003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 740/1536] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Oct 28 08:54:44 2021] POST /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:52.788597 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-3347d37c-7b5d-441d-8b97-c9a43623bbd1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:52.789131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-3347d37c-7b5d-441d-8b97-c9a43623bbd1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:52.795460 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3347d37c-7b5d-441d-8b97-c9a43623bbd1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:52.795904 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3347d37c-7b5d-441d-8b97-c9a43623bbd1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:52.797562 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3347d37c-7b5d-441d-8b97-c9a43623bbd1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:52.797709 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-3347d37c-7b5d-441d-8b97-c9a43623bbd1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:52.879131 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-3347d37c-7b5d-441d-8b97-c9a43623bbd1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lazy-loading 'services' on Instance uuid 0f9c707d-9384-416f-9181-499ac9dc8188 {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:54:52.951218 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-3347d37c-7b5d-441d-8b97-c9a43623bbd1 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188/os-volume_attachments/d6692642-b0a2-4667-a5fc-adec2b102273" status: 202 len: 0 microversion: 2.1 time: 0.166417 Oct 28 08:54:52.951817 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 797/1537] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Oct 28 08:54:52 2021] DELETE /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188/os-volume_attachments/d6692642-b0a2-4667-a5fc-adec2b102273 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:54:52.961067 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-c653aec0-74e7-4941-a79b-cfd13e5c69ab tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:52.962996 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-c653aec0-74e7-4941-a79b-cfd13e5c69ab tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:52.971445 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c653aec0-74e7-4941-a79b-cfd13e5c69ab tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:52.971882 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c653aec0-74e7-4941-a79b-cfd13e5c69ab tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:52.972721 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c653aec0-74e7-4941-a79b-cfd13e5c69ab tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:52.973262 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-c653aec0-74e7-4941-a79b-cfd13e5c69ab tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:53.010237 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-c653aec0-74e7-4941-a79b-cfd13e5c69ab tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053194 Oct 28 08:54:53.010808 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 741/1538] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:54:52 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:54.022733 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-82a9b8e9-68c8-4011-9d06-3f7d259e2b0d tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:54.023647 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-82a9b8e9-68c8-4011-9d06-3f7d259e2b0d tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:54.029856 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-82a9b8e9-68c8-4011-9d06-3f7d259e2b0d tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:54.030308 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-82a9b8e9-68c8-4011-9d06-3f7d259e2b0d tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:54.032050 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-82a9b8e9-68c8-4011-9d06-3f7d259e2b0d tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:54.032489 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-82a9b8e9-68c8-4011-9d06-3f7d259e2b0d tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:54.062769 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-82a9b8e9-68c8-4011-9d06-3f7d259e2b0d tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044672 Oct 28 08:54:54.063357 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 798/1539] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Oct 28 08:54:54 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:54:55.254154 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-1e4dd4be-c8c8-445b-8c50-1b00a7c5e229 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:55.254745 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1e4dd4be-c8c8-445b-8c50-1b00a7c5e229 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:55.261527 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e4dd4be-c8c8-445b-8c50-1b00a7c5e229 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:55.261995 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e4dd4be-c8c8-445b-8c50-1b00a7c5e229 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:55.262768 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e4dd4be-c8c8-445b-8c50-1b00a7c5e229 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:55.263193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-1e4dd4be-c8c8-445b-8c50-1b00a7c5e229 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:55.291717 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-1e4dd4be-c8c8-445b-8c50-1b00a7c5e229 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:54:55.368507 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-1e4dd4be-c8c8-445b-8c50-1b00a7c5e229 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 204 len: 0 microversion: 2.1 time: 0.119074 Oct 28 08:54:55.369366 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 742/1540] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:54:55 2021] DELETE /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:54:55.378115 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-2211ef4c-b5a2-4e40-a3b9-31a667e94dd3 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:55.378722 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-2211ef4c-b5a2-4e40-a3b9-31a667e94dd3 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:55.384972 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2211ef4c-b5a2-4e40-a3b9-31a667e94dd3 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:55.385420 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2211ef4c-b5a2-4e40-a3b9-31a667e94dd3 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:55.386228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2211ef4c-b5a2-4e40-a3b9-31a667e94dd3 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:55.386670 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-2211ef4c-b5a2-4e40-a3b9-31a667e94dd3 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:55.524036 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-2211ef4c-b5a2-4e40-a3b9-31a667e94dd3 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:55.531771 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-2211ef4c-b5a2-4e40-a3b9-31a667e94dd3 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1513 microversion: 2.1 time: 0.158205 Oct 28 08:54:55.532348 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 799/1541] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:55 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:56.550123 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-77902e90-cef8-4171-9001-70a0901679fe tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:56.550754 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-77902e90-cef8-4171-9001-70a0901679fe tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:56.557223 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-77902e90-cef8-4171-9001-70a0901679fe tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:56.557659 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-77902e90-cef8-4171-9001-70a0901679fe tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:56.558461 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-77902e90-cef8-4171-9001-70a0901679fe tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:56.558886 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-77902e90-cef8-4171-9001-70a0901679fe tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:56.704803 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-77902e90-cef8-4171-9001-70a0901679fe tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:56.712709 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-77902e90-cef8-4171-9001-70a0901679fe tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1513 microversion: 2.1 time: 0.167209 Oct 28 08:54:56.713305 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 743/1542] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:56 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:57.731586 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-a2ba0a00-8f90-40e5-b8ab-7652f0fea639 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:57.732292 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-a2ba0a00-8f90-40e5-b8ab-7652f0fea639 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:57.739735 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a2ba0a00-8f90-40e5-b8ab-7652f0fea639 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:57.740228 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a2ba0a00-8f90-40e5-b8ab-7652f0fea639 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:57.741011 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a2ba0a00-8f90-40e5-b8ab-7652f0fea639 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:57.741440 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-a2ba0a00-8f90-40e5-b8ab-7652f0fea639 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:57.883982 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-a2ba0a00-8f90-40e5-b8ab-7652f0fea639 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:57.892991 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-a2ba0a00-8f90-40e5-b8ab-7652f0fea639 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 200 len: 1513 microversion: 2.1 time: 0.165778 Oct 28 08:54:57.903744 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 800/1543] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:57 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:54:58.110405 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-5ecfd37b-7225-420a-bffb-812d886e26d4 req-d904b64b-c9fa-4b80-8316-eeae6847a5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9c707d-9384-416f-9181-499ac9dc8188", "name": "network-vif-deleted", "tag": "7dc3608d-196c-466e-b72c-7b40bbdba7d7"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:58.111961 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:54:58.111961 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:54:58.126070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-5ecfd37b-7225-420a-bffb-812d886e26d4 req-d904b64b-c9fa-4b80-8316-eeae6847a5ca service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:58.126070 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-5ecfd37b-7225-420a-bffb-812d886e26d4 req-d904b64b-c9fa-4b80-8316-eeae6847a5ca service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:58.133085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-5ecfd37b-7225-420a-bffb-812d886e26d4 req-d904b64b-c9fa-4b80-8316-eeae6847a5ca service nova] Creating event network-vif-deleted:7dc3608d-196c-466e-b72c-7b40bbdba7d7 for instance 0f9c707d-9384-416f-9181-499ac9dc8188 on hv-cinder-81566 Oct 28 08:54:58.138547 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-5ecfd37b-7225-420a-bffb-812d886e26d4 req-d904b64b-c9fa-4b80-8316-eeae6847a5ca service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176360 Oct 28 08:54:58.139153 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 744/1544] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:54:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:58.910053 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1d4572c9-f56c-4ce4-ac5f-e2ac476b37cb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:58.910742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-1d4572c9-f56c-4ce4-ac5f-e2ac476b37cb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 0f9c707d-9384-416f-9181-499ac9dc8188] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:58.917213 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1d4572c9-f56c-4ce4-ac5f-e2ac476b37cb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:58.917660 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1d4572c9-f56c-4ce4-ac5f-e2ac476b37cb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:58.918461 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1d4572c9-f56c-4ce4-ac5f-e2ac476b37cb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:58.918891 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-1d4572c9-f56c-4ce4-ac5f-e2ac476b37cb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:58.934102 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-1d4572c9-f56c-4ce4-ac5f-e2ac476b37cb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] HTTP exception thrown: Instance 0f9c707d-9384-416f-9181-499ac9dc8188 could not be found. Oct 28 08:54:58.934692 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-1d4572c9-f56c-4ce4-ac5f-e2ac476b37cb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Returning 404 to user: Instance 0f9c707d-9384-416f-9181-499ac9dc8188 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:54:58.935511 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-1d4572c9-f56c-4ce4-ac5f-e2ac476b37cb tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188" status: 404 len: 111 microversion: 2.1 time: 0.029368 Oct 28 08:54:58.936119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 801/1545] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:58 2021] GET /compute/v2.1/servers/0f9c707d-9384-416f-9181-499ac9dc8188 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:55:00.066917 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-297d8780-f57a-4dd6-b75e-f7e70b694b42 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:00.067509 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-297d8780-f57a-4dd6-b75e-f7e70b694b42 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:00.074227 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-297d8780-f57a-4dd6-b75e-f7e70b694b42 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:00.074678 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-297d8780-f57a-4dd6-b75e-f7e70b694b42 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:00.075456 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-297d8780-f57a-4dd6-b75e-f7e70b694b42 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:00.075889 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-297d8780-f57a-4dd6-b75e-f7e70b694b42 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:00.100593 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-297d8780-f57a-4dd6-b75e-f7e70b694b42 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Going to try to terminate instance {{(pid=132796) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:55:00.183180 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-297d8780-f57a-4dd6-b75e-f7e70b694b42 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 204 len: 0 microversion: 2.1 time: 0.120096 Oct 28 08:55:00.183746 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 745/1546] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:55:00 2021] DELETE /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:55:00.192478 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-b9f425c7-1f8b-44b6-aa19-af6cac606700 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:00.193084 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-b9f425c7-1f8b-44b6-aa19-af6cac606700 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:00.199525 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b9f425c7-1f8b-44b6-aa19-af6cac606700 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:00.199967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b9f425c7-1f8b-44b6-aa19-af6cac606700 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:00.200724 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b9f425c7-1f8b-44b6-aa19-af6cac606700 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:00.201153 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-b9f425c7-1f8b-44b6-aa19-af6cac606700 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:00.334907 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-b9f425c7-1f8b-44b6-aa19-af6cac606700 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:00.342383 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-b9f425c7-1f8b-44b6-aa19-af6cac606700 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1514 microversion: 2.1 time: 0.153567 Oct 28 08:55:00.342951 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 802/1547] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:00 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:01.360687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-21097284-aadf-4b87-a4d3-08ba41b23902 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:01.361388 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-21097284-aadf-4b87-a4d3-08ba41b23902 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:01.367727 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21097284-aadf-4b87-a4d3-08ba41b23902 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:01.368162 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21097284-aadf-4b87-a4d3-08ba41b23902 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:01.368919 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21097284-aadf-4b87-a4d3-08ba41b23902 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:01.369348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-21097284-aadf-4b87-a4d3-08ba41b23902 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:01.503206 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-21097284-aadf-4b87-a4d3-08ba41b23902 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:01.511537 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-21097284-aadf-4b87-a4d3-08ba41b23902 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1514 microversion: 2.1 time: 0.155630 Oct 28 08:55:01.512193 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 746/1548] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:01 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:55:02.533312 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-9b92413f-cf5c-441d-93b8-2bd60fa53ff8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:02.535652 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-9b92413f-cf5c-441d-93b8-2bd60fa53ff8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:02.553694 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b92413f-cf5c-441d-93b8-2bd60fa53ff8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:02.554554 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b92413f-cf5c-441d-93b8-2bd60fa53ff8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:02.555997 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b92413f-cf5c-441d-93b8-2bd60fa53ff8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:02.557023 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-9b92413f-cf5c-441d-93b8-2bd60fa53ff8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:02.603788 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-cfa6ada9-3b04-4852-beef-0f4b70cce993 req-2d733fbe-e894-4bc2-843f-c5f6a79e7827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7", "name": "network-vif-deleted", "tag": "6a3666ca-6772-446f-93c4-06112a50eafa"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:55:02.605579 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:55:02.605579 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:55:02.616790 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-cfa6ada9-3b04-4852-beef-0f4b70cce993 req-2d733fbe-e894-4bc2-843f-c5f6a79e7827 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:02.617437 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-cfa6ada9-3b04-4852-beef-0f4b70cce993 req-2d733fbe-e894-4bc2-843f-c5f6a79e7827 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:02.631997 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-cfa6ada9-3b04-4852-beef-0f4b70cce993 req-2d733fbe-e894-4bc2-843f-c5f6a79e7827 service nova] Creating event network-vif-deleted:6a3666ca-6772-446f-93c4-06112a50eafa for instance 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 on hv-cinder-81566 Oct 28 08:55:02.637082 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-cfa6ada9-3b04-4852-beef-0f4b70cce993 req-2d733fbe-e894-4bc2-843f-c5f6a79e7827 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036945 Oct 28 08:55:02.637953 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 747/1549] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:55:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:55:02.736078 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-9b92413f-cf5c-441d-93b8-2bd60fa53ff8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:02.743750 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-9b92413f-cf5c-441d-93b8-2bd60fa53ff8 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 200 len: 1472 microversion: 2.1 time: 0.218564 Oct 28 08:55:02.744323 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 803/1550] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:02 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:03.762264 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-45e98521-de79-4bff-a003-e7913c1eb67e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:03.762961 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-45e98521-de79-4bff-a003-e7913c1eb67e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:03.769348 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45e98521-de79-4bff-a003-e7913c1eb67e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:03.769813 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45e98521-de79-4bff-a003-e7913c1eb67e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:03.770581 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45e98521-de79-4bff-a003-e7913c1eb67e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:03.771019 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-45e98521-de79-4bff-a003-e7913c1eb67e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:03.784246 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-45e98521-de79-4bff-a003-e7913c1eb67e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] HTTP exception thrown: Instance 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 could not be found. Oct 28 08:55:03.784827 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-45e98521-de79-4bff-a003-e7913c1eb67e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Returning 404 to user: Instance 1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:55:03.785741 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-45e98521-de79-4bff-a003-e7913c1eb67e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7" status: 404 len: 111 microversion: 2.1 time: 0.028151 Oct 28 08:55:03.786287 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 748/1551] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:03 2021] GET /compute/v2.1/servers/1a1a9e2e-dda2-4920-9da9-f7c5f5ce6cf7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:55:03.794579 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-45eb5aa7-3264-40b8-935d-7cd26186896f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:03.798182 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-45eb5aa7-3264-40b8-935d-7cd26186896f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:03.804642 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-45eb5aa7-3264-40b8-935d-7cd26186896f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:03.805190 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-45eb5aa7-3264-40b8-935d-7cd26186896f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:03.806039 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-45eb5aa7-3264-40b8-935d-7cd26186896f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:03.806494 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-45eb5aa7-3264-40b8-935d-7cd26186896f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:03.831499 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-45eb5aa7-3264-40b8-935d-7cd26186896f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Going to try to terminate instance {{(pid=132797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:55:03.910181 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-45eb5aa7-3264-40b8-935d-7cd26186896f tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 204 len: 0 microversion: 2.1 time: 0.118737 Oct 28 08:55:03.911025 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 804/1552] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:55:03 2021] DELETE /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:55:03.919523 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-fa3a4e85-b846-468b-a7f0-a124f252f546 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:03.920127 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-fa3a4e85-b846-468b-a7f0-a124f252f546 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:03.928003 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa3a4e85-b846-468b-a7f0-a124f252f546 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:03.928531 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa3a4e85-b846-468b-a7f0-a124f252f546 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:03.929364 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa3a4e85-b846-468b-a7f0-a124f252f546 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:03.929958 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-fa3a4e85-b846-468b-a7f0-a124f252f546 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:04.125687 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-fa3a4e85-b846-468b-a7f0-a124f252f546 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:04.133125 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-fa3a4e85-b846-468b-a7f0-a124f252f546 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1514 microversion: 2.1 time: 0.217429 Oct 28 08:55:04.133685 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 749/1553] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:03 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:05.151447 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-bda2c999-96f1-437c-b030-12a84ef4b8b7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:05.152144 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-bda2c999-96f1-437c-b030-12a84ef4b8b7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:05.159421 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bda2c999-96f1-437c-b030-12a84ef4b8b7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:05.159881 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bda2c999-96f1-437c-b030-12a84ef4b8b7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:05.160686 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bda2c999-96f1-437c-b030-12a84ef4b8b7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:05.161119 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-bda2c999-96f1-437c-b030-12a84ef4b8b7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:05.295486 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-bda2c999-96f1-437c-b030-12a84ef4b8b7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:05.304157 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-bda2c999-96f1-437c-b030-12a84ef4b8b7 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1514 microversion: 2.1 time: 0.156839 Oct 28 08:55:05.304742 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 805/1554] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:05 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:06.030719 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [req-05fdb5a4-31c8-46a6-9a8a-0aa792cf7d5c req-c1e4cb1f-45c1-4ea2-bea3-2218ae971531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3169d26-f614-4421-bc29-c09940bbc06f", "name": "network-vif-deleted", "tag": "f2d8a5ff-605d-4534-b144-6688523ec819"}]} {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:55:06.032987 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:55:06.032987 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: warnings.warn(msg) Oct 28 08:55:06.050619 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-05fdb5a4-31c8-46a6-9a8a-0aa792cf7d5c req-c1e4cb1f-45c1-4ea2-bea3-2218ae971531 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:06.051470 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [req-05fdb5a4-31c8-46a6-9a8a-0aa792cf7d5c req-c1e4cb1f-45c1-4ea2-bea3-2218ae971531 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:06.065416 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.compute.server_external_events [req-05fdb5a4-31c8-46a6-9a8a-0aa792cf7d5c req-c1e4cb1f-45c1-4ea2-bea3-2218ae971531 service nova] Creating event network-vif-deleted:f2d8a5ff-605d-4534-b144-6688523ec819 for instance a3169d26-f614-4421-bc29-c09940bbc06f on hv-cinder-81566 Oct 28 08:55:06.071937 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [req-05fdb5a4-31c8-46a6-9a8a-0aa792cf7d5c req-c1e4cb1f-45c1-4ea2-bea3-2218ae971531 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045525 Oct 28 08:55:06.072538 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 750/1555] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:55:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:55:06.322674 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:06.323313 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:06.329813 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:06.330279 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:06.331060 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:06.331499 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:06.370446 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:06.370894 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:06.371351 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.objects.instance [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lazy-loading 'fault' on Instance uuid a3169d26-f614-4421-bc29-c09940bbc06f {{(pid=132797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:55:06.414334 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:06.423597 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-c0ec9322-3b8a-4a14-991d-b1c895f2e50e tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 200 len: 1307 microversion: 2.1 time: 0.105177 Oct 28 08:55:06.424195 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 806/1556] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:06 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:07.441438 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b537483c-42f2-406e-a05e-860691f1d190 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:07.442180 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-b537483c-42f2-406e-a05e-860691f1d190 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: a3169d26-f614-4421-bc29-c09940bbc06f] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:07.448567 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b537483c-42f2-406e-a05e-860691f1d190 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:07.449006 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b537483c-42f2-406e-a05e-860691f1d190 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:07.449769 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b537483c-42f2-406e-a05e-860691f1d190 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:07.450212 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-b537483c-42f2-406e-a05e-860691f1d190 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:07.464772 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.wsgi [None req-b537483c-42f2-406e-a05e-860691f1d190 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] HTTP exception thrown: Instance a3169d26-f614-4421-bc29-c09940bbc06f could not be found. Oct 28 08:55:07.465509 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-b537483c-42f2-406e-a05e-860691f1d190 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Returning 404 to user: Instance a3169d26-f614-4421-bc29-c09940bbc06f could not be found. {{(pid=132796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:55:07.466864 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-b537483c-42f2-406e-a05e-860691f1d190 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f" status: 404 len: 111 microversion: 2.1 time: 0.029113 Oct 28 08:55:07.467444 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 751/1557] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:07 2021] GET /compute/v2.1/servers/a3169d26-f614-4421-bc29-c09940bbc06f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:55:08.633125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-5a0c15f7-c625-49ef-9ae5-07b38de09a19 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:08.633637 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5a0c15f7-c625-49ef-9ae5-07b38de09a19 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:08.639695 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5a0c15f7-c625-49ef-9ae5-07b38de09a19 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:08.640234 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5a0c15f7-c625-49ef-9ae5-07b38de09a19 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:08.640997 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5a0c15f7-c625-49ef-9ae5-07b38de09a19 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:08.641420 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-5a0c15f7-c625-49ef-9ae5-07b38de09a19 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:08.666858 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-5a0c15f7-c625-49ef-9ae5-07b38de09a19 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Going to try to terminate instance {{(pid=132797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:55:08.745917 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-5a0c15f7-c625-49ef-9ae5-07b38de09a19 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 204 len: 0 microversion: 2.1 time: 0.116057 Oct 28 08:55:08.746732 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 807/1558] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Oct 28 08:55:08 2021] DELETE /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:55:08.755540 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-22242eb2-a798-44f4-bb63-39483013f848 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:08.756210 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-22242eb2-a798-44f4-bb63-39483013f848 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:08.770640 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22242eb2-a798-44f4-bb63-39483013f848 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:08.771085 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22242eb2-a798-44f4-bb63-39483013f848 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:08.771852 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22242eb2-a798-44f4-bb63-39483013f848 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:08.772280 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-22242eb2-a798-44f4-bb63-39483013f848 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:08.896561 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-22242eb2-a798-44f4-bb63-39483013f848 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:08.903825 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-22242eb2-a798-44f4-bb63-39483013f848 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1515 microversion: 2.1 time: 0.151981 Oct 28 08:55:08.904380 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 752/1559] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:08 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:09.928754 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-03c8b1ca-0e6b-45da-acdd-d7ad0c0765a4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:09.929453 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-03c8b1ca-0e6b-45da-acdd-d7ad0c0765a4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:09.935672 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03c8b1ca-0e6b-45da-acdd-d7ad0c0765a4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:09.936112 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03c8b1ca-0e6b-45da-acdd-d7ad0c0765a4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:09.937063 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03c8b1ca-0e6b-45da-acdd-d7ad0c0765a4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:09.937529 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-03c8b1ca-0e6b-45da-acdd-d7ad0c0765a4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:10.075476 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.policy [None req-03c8b1ca-0e6b-45da-acdd-d7ad0c0765a4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:10.083712 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-03c8b1ca-0e6b-45da-acdd-d7ad0c0765a4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1515 microversion: 2.1 time: 0.159021 Oct 28 08:55:10.084287 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 808/1560] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:09 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:55:11.101604 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.api.openstack.wsgi [None req-72e5d3f6-87b5-462b-aa19-5d1e3da72fc4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:11.102321 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.compute.api [None req-72e5d3f6-87b5-462b-aa19-5d1e3da72fc4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132796) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:11.103140 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [req-374346a2-d954-46c2-ad2f-3e3ce11823b9 req-ee803e40-2f94-43a5-9cd0-42d695f3e568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d2e5b11-789c-403e-a726-3c7f0412bc44", "name": "network-vif-deleted", "tag": "6e84e39e-941c-43f6-9052-8a92be7b65cb"}]} {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:55:11.105493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:55:11.105493 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: warnings.warn(msg) Oct 28 08:55:11.111461 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-72e5d3f6-87b5-462b-aa19-5d1e3da72fc4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:11.112106 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-72e5d3f6-87b5-462b-aa19-5d1e3da72fc4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:11.112931 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-72e5d3f6-87b5-462b-aa19-5d1e3da72fc4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:11.113427 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG oslo_concurrency.lockutils [None req-72e5d3f6-87b5-462b-aa19-5d1e3da72fc4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:11.114967 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-374346a2-d954-46c2-ad2f-3e3ce11823b9 req-ee803e40-2f94-43a5-9cd0-42d695f3e568 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:11.115668 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [req-374346a2-d954-46c2-ad2f-3e3ce11823b9 req-ee803e40-2f94-43a5-9cd0-42d695f3e568 service nova] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:11.128107 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.compute.server_external_events [req-374346a2-d954-46c2-ad2f-3e3ce11823b9 req-ee803e40-2f94-43a5-9cd0-42d695f3e568 service nova] Creating event network-vif-deleted:6e84e39e-941c-43f6-9052-8a92be7b65cb for instance 1d2e5b11-789c-403e-a726-3c7f0412bc44 on hv-cinder-81566 Oct 28 08:55:11.133125 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [req-374346a2-d954-46c2-ad2f-3e3ce11823b9 req-ee803e40-2f94-43a5-9cd0-42d695f3e568 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033633 Oct 28 08:55:11.133750 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 809/1561] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Oct 28 08:55:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:55:11.184051 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: DEBUG nova.policy [None req-72e5d3f6-87b5-462b-aa19-5d1e3da72fc4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff8a38c0bd4f559355a124f8a0588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272e5ae4aa8045a38003e59b113e7898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132796) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:11.193046 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO nova.api.openstack.requestlog [None req-72e5d3f6-87b5-462b-aa19-5d1e3da72fc4 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 200 len: 1473 microversion: 2.1 time: 0.095100 Oct 28 08:55:11.194243 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: [pid: 132796|app: 0|req: 753/1562] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:11 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 1473 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:12.211542 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-04c57aa8-0216-42ae-ad12-1f63cbd52cd6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Calling method '>' {{(pid=132797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:12.212242 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.compute.api [None req-04c57aa8-0216-42ae-ad12-1f63cbd52cd6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] [instance: 1d2e5b11-789c-403e-a726-3c7f0412bc44] Fetching instance by UUID {{(pid=132797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:12.218390 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04c57aa8-0216-42ae-ad12-1f63cbd52cd6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:12.218837 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04c57aa8-0216-42ae-ad12-1f63cbd52cd6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:12.219608 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04c57aa8-0216-42ae-ad12-1f63cbd52cd6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:12.220051 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG oslo_concurrency.lockutils [None req-04c57aa8-0216-42ae-ad12-1f63cbd52cd6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Lock "53658e27-76fc-4752-a30c-0afc17fb2e9d" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:12.232918 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.wsgi [None req-04c57aa8-0216-42ae-ad12-1f63cbd52cd6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] HTTP exception thrown: Instance 1d2e5b11-789c-403e-a726-3c7f0412bc44 could not be found. Oct 28 08:55:12.233547 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: DEBUG nova.api.openstack.wsgi [None req-04c57aa8-0216-42ae-ad12-1f63cbd52cd6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] Returning 404 to user: Instance 1d2e5b11-789c-403e-a726-3c7f0412bc44 could not be found. {{(pid=132797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:55:12.234458 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO nova.api.openstack.requestlog [None req-04c57aa8-0216-42ae-ad12-1f63cbd52cd6 tempest-AttachVolumeNegativeTest-533596429 tempest-AttachVolumeNegativeTest-533596429-project] 10.222.0.74 "GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44" status: 404 len: 111 microversion: 2.1 time: 0.027540 Oct 28 08:55:12.234989 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: [pid: 132797|app: 0|req: 810/1563] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:12 2021] GET /compute/v2.1/servers/1d2e5b11-789c-403e-a726-3c7f0412bc44 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:56:29.908570 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:56:29.909296 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: Thu Oct 28 08:56:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:56:40.487570 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:56:40.488218 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: Thu Oct 28 08:56:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:59:44.887271 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:59:44.887935 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: Thu Oct 28 08:59:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:59:49.928229 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:59:49.928915 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: Thu Oct 28 08:59:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:59:59.486992 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:59:59.487627 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: Thu Oct 28 08:59:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:00:00.506233 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:00:00.506968 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: Thu Oct 28 09:00:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:00:11.536957 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:00:11.537632 dv-cinder-815660-3-iscsi devstack@n-api.service[132796]: Thu Oct 28 09:00:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:00:18.735711 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:00:18.736362 dv-cinder-815660-3-iscsi devstack@n-api.service[132797]: Thu Oct 28 09:00:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!